Apr 12 10:29:02 user devstack@n-api.service[61851]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 12 10:29:02 user devstack@n-api.service[61851]: *** Starting uWSGI 2.0.20-debian (64bit) on [Wed Apr 12 10:29:02 2023] *** Apr 12 10:29:02 user devstack@n-api.service[61851]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 12 10:29:02 user devstack@n-api.service[61851]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 12 10:29:02 user devstack@n-api.service[61851]: nodename: user Apr 12 10:29:02 user devstack@n-api.service[61851]: machine: x86_64 Apr 12 10:29:02 user devstack@n-api.service[61851]: clock source: unix Apr 12 10:29:02 user devstack@n-api.service[61851]: pcre jit disabled Apr 12 10:29:02 user devstack@n-api.service[61851]: detected number of CPU cores: 12 Apr 12 10:29:02 user devstack@n-api.service[61851]: current working directory: / Apr 12 10:29:02 user devstack@n-api.service[61851]: detected binary path: /usr/bin/uwsgi-core Apr 12 10:29:02 user devstack@n-api.service[61851]: your processes number limit is 63637 Apr 12 10:29:02 user devstack@n-api.service[61851]: your memory page size is 4096 bytes Apr 12 10:29:02 user devstack@n-api.service[61851]: detected max file descriptor number: 2048 Apr 12 10:29:02 user devstack@n-api.service[61851]: lock engine: pthread robust mutexes Apr 12 10:29:02 user devstack@n-api.service[61851]: thunder lock: enabled Apr 12 10:29:02 user devstack@n-api.service[61851]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 12 10:29:02 user devstack@n-api.service[61851]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 12 10:29:02 user devstack@n-api.service[61851]: Python main interpreter initialized at 0x55b0d53ad990 Apr 12 10:29:02 user devstack@n-api.service[61851]: python threads support enabled Apr 12 10:29:02 user devstack@n-api.service[61851]: your server socket listen backlog is limited to 100 connections Apr 12 10:29:02 user devstack@n-api.service[61851]: your mercy for graceful operations on workers is 90 seconds Apr 12 10:29:02 user devstack@n-api.service[61851]: mapped 537436 bytes (524 KB) for 3 cores Apr 12 10:29:02 user devstack@n-api.service[61851]: *** Operational MODE: preforking *** Apr 12 10:29:02 user devstack@n-api.service[61851]: *** uWSGI is running in multiple interpreter mode *** Apr 12 10:29:02 user devstack@n-api.service[61851]: spawned uWSGI master process (pid: 61851) Apr 12 10:29:02 user devstack@n-api.service[61851]: spawned uWSGI worker 1 (pid: 61852, cores: 1) Apr 12 10:29:02 user devstack@n-api.service[61851]: spawned uWSGI worker 2 (pid: 61853, cores: 1) Apr 12 10:29:02 user devstack@n-api.service[61851]: spawned uWSGI worker 3 (pid: 61854, cores: 1) Apr 12 10:29:02 user devstack@n-api.service[61851]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 12 10:29:03 user devstack@n-api.service[61854]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 10:29:03 user devstack@n-api.service[61852]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 10:29:03 user devstack@n-api.service[61853]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 10:29:06 user devstack@n-api.service[61853]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 10:29:06 user devstack@n-api.service[61853]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 10:29:06 user devstack@n-api.service[61853]: and ``live_migration_inbound_addr`` respectively. Apr 12 10:29:06 user devstack@n-api.service[61853]: ). Its value may be silently ignored in the future. Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 10:29:06 user devstack@n-api.service[61854]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 10:29:06 user devstack@n-api.service[61854]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 10:29:06 user devstack@n-api.service[61854]: and ``live_migration_inbound_addr`` respectively. Apr 12 10:29:06 user devstack@n-api.service[61854]: ). Its value may be silently ignored in the future. Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 10:29:06 user devstack@n-api.service[61852]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 10:29:06 user devstack@n-api.service[61852]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 10:29:06 user devstack@n-api.service[61852]: and ``live_migration_inbound_addr`` respectively. Apr 12 10:29:06 user devstack@n-api.service[61852]: ). Its value may be silently ignored in the future. Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61853) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61854) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61852) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 10:29:07 user devstack@n-api.service[61853]: INFO dbcounter [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] Registered counter for database nova_api Apr 12 10:29:07 user devstack@n-api.service[61854]: INFO dbcounter [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] Registered counter for database nova_api Apr 12 10:29:07 user devstack@n-api.service[61853]: DEBUG oslo_db.sqlalchemy.engines [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61853) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 10:29:07 user devstack@n-api.service[61854]: DEBUG oslo_db.sqlalchemy.engines [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61854) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 10:29:07 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writer thread running {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 10:29:07 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writer thread running {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 10:29:07 user devstack@n-api.service[61852]: INFO dbcounter [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Registered counter for database nova_api Apr 12 10:29:07 user devstack@n-api.service[61853]: DEBUG nova.context [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9de702a6-515a-4e6a-adff-f5fd602a6708(cell1) {{(pid=61853) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG oslo_db.sqlalchemy.engines [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61852) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 10:29:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:29:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:29:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:29:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:29:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writer thread running {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 10:29:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:29:07 user devstack@n-api.service[61853]: INFO dbcounter [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] Registered counter for database nova_cell0 Apr 12 10:29:07 user devstack@n-api.service[61854]: DEBUG nova.context [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9de702a6-515a-4e6a-adff-f5fd602a6708(cell1) {{(pid=61854) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 10:29:07 user devstack@n-api.service[61853]: INFO dbcounter [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] Registered counter for database nova_cell1 Apr 12 10:29:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:29:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:29:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:29:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:29:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:29:07 user devstack@n-api.service[61853]: DEBUG oslo_db.sqlalchemy.engines [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61853) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 10:29:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:29:07 user devstack@n-api.service[61853]: DEBUG oslo_db.sqlalchemy.engines [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61853) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 10:29:07 user devstack@n-api.service[61854]: INFO dbcounter [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] Registered counter for database nova_cell0 Apr 12 10:29:07 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writer thread running {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 10:29:07 user devstack@n-api.service[61854]: INFO dbcounter [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] Registered counter for database nova_cell1 Apr 12 10:29:07 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writer thread running {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 10:29:07 user devstack@n-api.service[61854]: DEBUG oslo_db.sqlalchemy.engines [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61854) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 10:29:07 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writer thread running {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 10:29:07 user devstack@n-api.service[61854]: DEBUG oslo_db.sqlalchemy.engines [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61854) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG nova.context [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9de702a6-515a-4e6a-adff-f5fd602a6708(cell1) {{(pid=61852) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:29:07 user devstack@n-api.service[61852]: INFO dbcounter [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Registered counter for database nova_cell0 Apr 12 10:29:07 user devstack@n-api.service[61852]: INFO dbcounter [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Registered counter for database nova_cell1 Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG oslo_db.sqlalchemy.engines [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61852) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writer thread running {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG oslo_db.sqlalchemy.engines [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61852) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 10:29:07 user devstack@n-api.service[61853]: INFO dbcounter [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] Registered counter for database nova_cell0 Apr 12 10:29:07 user devstack@n-api.service[61853]: DEBUG oslo_db.sqlalchemy.engines [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61853) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 10:29:07 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writer thread running {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 10:29:07 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writer thread running {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 10:29:07 user devstack@n-api.service[61854]: INFO dbcounter [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] Registered counter for database nova_cell0 Apr 12 10:29:07 user devstack@n-api.service[61854]: DEBUG oslo_db.sqlalchemy.engines [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61854) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 10:29:07 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writer thread running {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writer thread running {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 10:29:07 user devstack@n-api.service[61852]: INFO dbcounter [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Registered counter for database nova_cell0 Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG oslo_db.sqlalchemy.engines [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61852) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 10:29:07 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writer thread running {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 10:29:07 user devstack@n-api.service[61853]: WARNING keystonemiddleware.auth_token [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 10:29:07 user devstack@n-api.service[61853]: WARNING keystonemiddleware.auth_token [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 10:29:07 user devstack@n-api.service[61854]: WARNING keystonemiddleware.auth_token [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 10:29:07 user devstack@n-api.service[61854]: WARNING keystonemiddleware.auth_token [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 10:29:07 user devstack@n-api.service[61852]: WARNING keystonemiddleware.auth_token [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 10:29:07 user devstack@n-api.service[61852]: WARNING keystonemiddleware.auth_token [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 10:29:07 user devstack@n-api.service[61853]: WARNING keystonemiddleware.auth_token [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 10:29:07 user devstack@n-api.service[61853]: WARNING keystonemiddleware.auth_token [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 10:29:07 user devstack@n-api.service[61853]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b0d53ad990 pid: 61853 (default app) Apr 12 10:29:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:29:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001490 Apr 12 10:29:07 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Wed Apr 12 10:29:07 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:29:07 user devstack@n-api.service[61854]: WARNING keystonemiddleware.auth_token [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 10:29:07 user devstack@n-api.service[61854]: WARNING keystonemiddleware.auth_token [None req-b542c222-e25b-42a2-86aa-7008a4589324 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 10:29:07 user devstack@n-api.service[61854]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b0d53ad990 pid: 61854 (default app) Apr 12 10:29:07 user devstack@n-api.service[61852]: WARNING keystonemiddleware.auth_token [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 10:29:07 user devstack@n-api.service[61852]: WARNING keystonemiddleware.auth_token [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 10:29:07 user devstack@n-api.service[61852]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b0d53ad990 pid: 61852 (default app) Apr 12 10:31:13 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:31:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8c86ff22-8142-4fce-9c62-4b144014ce1d None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001580 Apr 12 10:31:13 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 10:31:13 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:31:13 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:31:13 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:31:13 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:31:13 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:31:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8778176b-caf9-4e51-9c8e-cec671abe9d8 admin admin] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:31:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8778176b-caf9-4e51-9c8e-cec671abe9d8 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.383311 Apr 12 10:31:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 12 10:31:13 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:31:15 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:31:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002219 Apr 12 10:31:15 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 10:31:15 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:31:15 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:31:15 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:31:15 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:31:15 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:31:15 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f66a091a-933c-4055-a4ee-7b4e626875bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f66a091a-933c-4055-a4ee-7b4e626875bb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.316618 Apr 12 10:31:15 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 10:31:15 2023] POST /compute/v2.1/flavors => generated 405 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:31:15 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-22f81df4-4f76-44a6-8581-5397c9b6cbc8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:15 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-22f81df4-4f76-44a6-8581-5397c9b6cbc8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.066689 Apr 12 10:31:15 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 10:31:15 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:31:17 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:31:17 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001287 Apr 12 10:31:17 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 10:31:17 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:31:17 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3d816022-98e0-4d65-90eb-0a6c4b109c0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "id": "d1"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:17 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-3d816022-98e0-4d65-90eb-0a6c4b109c0c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.065867 Apr 12 10:31:17 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 10:31:17 2023] POST /compute/v2.1/flavors => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:31:17 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b6334dd4-444b-46f0-b99a-b85c6ec5e5c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:17 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b6334dd4-444b-46f0-b99a-b85c6ec5e5c4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027947 Apr 12 10:31:17 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 10:31:17 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:31:19 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:31:19 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001350 Apr 12 10:31:19 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 10:31:19 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:31:19 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ed6b44e2-68ee-46bf-a385-e3a8827e627b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-ed6b44e2-68ee-46bf-a385-e3a8827e627b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.060788 Apr 12 10:31:19 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 10:31:19 2023] POST /compute/v2.1/flavors => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:31:19 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-152f8263-b6f0-49fa-a669-cc5b146e0e66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:19 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-152f8263-b6f0-49fa-a669-cc5b146e0e66 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029728 Apr 12 10:31:19 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 10:31:19 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:31:21 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:31:21 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001394 Apr 12 10:31:21 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 10:31:21 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:31:21 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0081366b-b8b4-4c62-bef4-11ce935dd3cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-0081366b-b8b4-4c62-bef4-11ce935dd3cf admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.060130 Apr 12 10:31:21 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 10:31:21 2023] POST /compute/v2.1/flavors => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:31:21 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-05fab73a-78d4-4aa9-875b-c6e1431b025c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-05fab73a-78d4-4aa9-875b-c6e1431b025c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028205 Apr 12 10:31:21 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 10:31:21 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:31:23 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:31:23 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001299 Apr 12 10:31:23 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 10:31:23 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:31:23 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1125f78f-c289-40af-a93e-9603182bdbc1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 4096, "id": "d4", "rxtx_factor": 1.0}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1125f78f-c289-40af-a93e-9603182bdbc1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.061469 Apr 12 10:31:23 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 10:31:23 2023] POST /compute/v2.1/flavors => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:31:23 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-78e0e174-8c61-4087-8e5d-51d706b04870 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-78e0e174-8c61-4087-8e5d-51d706b04870 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025967 Apr 12 10:31:23 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 10:31:23 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:31:25 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:31:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-3f0f3360-7391-40da-9b16-df7341c3edb0 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001651 Apr 12 10:31:25 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 10:31:25 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:31:26 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-9ff02e40-67f7-47d6-9249-5274cee4c8af admin admin] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:31:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-9ff02e40-67f7-47d6-9249-5274cee4c8af admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.093261 Apr 12 10:31:26 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 12 10:31:25 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:31:28 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-78e0e174-8c61-4087-8e5d-51d706b04870 admin admin] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:31:28 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-78e0e174-8c61-4087-8e5d-51d706b04870 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001559 Apr 12 10:31:28 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 10:31:28 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:31:28 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=3 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:31:28 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=3 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:31:28 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=3 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:31:28 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=3 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:31:28 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-4e58a84c-64ff-422f-a2b8-8416d12e2a52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "name": "m1.tiny"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:28 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-4e58a84c-64ff-422f-a2b8-8416d12e2a52 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.303925 Apr 12 10:31:28 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 10:31:28 2023] POST /compute/v2.1/flavors => generated 400 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:31:28 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1c25e696-ed5e-479f-9ffb-567a2058d82f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1c25e696-ed5e-479f-9ffb-567a2058d82f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036095 Apr 12 10:31:28 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 10:31:28 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:31:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-78e0e174-8c61-4087-8e5d-51d706b04870 admin admin] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:31:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-78e0e174-8c61-4087-8e5d-51d706b04870 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001403 Apr 12 10:31:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 10:31:30 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:31:30 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-49d73880-12f9-4a6f-94af-38fa7a42633b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:30 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-49d73880-12f9-4a6f-94af-38fa7a42633b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.057094 Apr 12 10:31:30 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 10:31:30 2023] POST /compute/v2.1/flavors => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:31:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-49292cfc-1c1b-48ac-b0d0-2f4a5172facc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-49292cfc-1c1b-48ac-b0d0-2f4a5172facc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027605 Apr 12 10:31:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 10:31:30 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:31:32 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-78e0e174-8c61-4087-8e5d-51d706b04870 admin admin] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:31:32 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-78e0e174-8c61-4087-8e5d-51d706b04870 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002012 Apr 12 10:31:32 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 10:31:32 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:31:32 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-1573f5b5-6369-4aa6-93e4-1253900ebaea admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "disk": 40}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:32 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-1573f5b5-6369-4aa6-93e4-1253900ebaea admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.061845 Apr 12 10:31:32 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 10:31:32 2023] POST /compute/v2.1/flavors => generated 404 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:31:32 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-aad728da-a775-4151-a106-a0c6f9b5e0be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:32 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-aad728da-a775-4151-a106-a0c6f9b5e0be admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026949 Apr 12 10:31:32 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 10:31:32 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:31:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-78e0e174-8c61-4087-8e5d-51d706b04870 admin admin] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:31:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-78e0e174-8c61-4087-8e5d-51d706b04870 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001578 Apr 12 10:31:34 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 10:31:34 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:31:34 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-e76fb428-1b4b-4c2c-af9b-8186af64c2d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "id": "4", "ram": 8192, "name": "m1.large"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:34 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-e76fb428-1b4b-4c2c-af9b-8186af64c2d7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.061532 Apr 12 10:31:34 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 10:31:34 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:31:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-09fef783-6cfb-49c4-942b-b7c0a1c6a1c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-09fef783-6cfb-49c4-942b-b7c0a1c6a1c5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025449 Apr 12 10:31:34 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 10:31:34 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:31:36 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-78e0e174-8c61-4087-8e5d-51d706b04870 admin admin] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:31:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-78e0e174-8c61-4087-8e5d-51d706b04870 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001422 Apr 12 10:31:36 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 10:31:36 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:31:36 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-312bab24-6e3d-4090-be2b-936a2e41faec admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "disk": 160, "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "id": "5"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:36 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-312bab24-6e3d-4090-be2b-936a2e41faec admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.058001 Apr 12 10:31:36 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 10:31:36 2023] POST /compute/v2.1/flavors => generated 406 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:31:36 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-54eed77f-7fd4-4911-8970-ef25cf37f088 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:31:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-54eed77f-7fd4-4911-8970-ef25cf37f088 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026924 Apr 12 10:31:36 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 10:31:36 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:32:07 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-78e0e174-8c61-4087-8e5d-51d706b04870 admin admin] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:32:07 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-78e0e174-8c61-4087-8e5d-51d706b04870 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001521 Apr 12 10:32:07 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 10:32:07 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:32:07 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:32:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-de5be5f5-bc0c-4aff-a4b9-1333eeb4dcbb admin admin] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:32:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-de5be5f5-bc0c-4aff-a4b9-1333eeb4dcbb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:32:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-de5be5f5-bc0c-4aff-a4b9-1333eeb4dcbb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:32:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-de5be5f5-bc0c-4aff-a4b9-1333eeb4dcbb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:32:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-de5be5f5-bc0c-4aff-a4b9-1333eeb4dcbb admin admin] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:32:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-de5be5f5-bc0c-4aff-a4b9-1333eeb4dcbb admin admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:32:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-de5be5f5-bc0c-4aff-a4b9-1333eeb4dcbb admin admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:32:07 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-de5be5f5-bc0c-4aff-a4b9-1333eeb4dcbb admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.087359 Apr 12 10:32:07 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Wed Apr 12 10:32:07 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:32:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-54eed77f-7fd4-4911-8970-ef25cf37f088 admin admin] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:32:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-54eed77f-7fd4-4911-8970-ef25cf37f088 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002402 Apr 12 10:32:39 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 10:32:39 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:32:39 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:32:39 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5bcfb4b3-27bc-4096-bc8f-833a8482cf17 admin admin] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:32:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5bcfb4b3-27bc-4096-bc8f-833a8482cf17 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.062631 Apr 12 10:32:39 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Wed Apr 12 10:32:39 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:32:44 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-de5be5f5-bc0c-4aff-a4b9-1333eeb4dcbb admin admin] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:32:44 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-de5be5f5-bc0c-4aff-a4b9-1333eeb4dcbb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001345 Apr 12 10:32:44 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 10:32:44 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:32:44 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:32:44 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3208454a-5fdc-4c23-b94f-a1cbd24f671a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "42", "swap": 0, "rxtx_factor": 1.0, "ram": 128, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:32:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-3208454a-5fdc-4c23-b94f-a1cbd24f671a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.067296 Apr 12 10:32:44 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 12 10:32:44 2023] POST /compute/v2.1/flavors => generated 403 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:32:44 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-bba9e480-2c5e-4d95-aee2-cc302a486ec9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:32:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-bba9e480-2c5e-4d95-aee2-cc302a486ec9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027707 Apr 12 10:32:44 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 12 10:32:44 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:32:48 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-de5be5f5-bc0c-4aff-a4b9-1333eeb4dcbb admin admin] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:32:48 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-de5be5f5-bc0c-4aff-a4b9-1333eeb4dcbb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002225 Apr 12 10:32:48 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 10:32:48 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:32:48 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-aee6258c-1971-4910-be05-93a0e93daf2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "84", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "ram": 192, "name": "m1.micro"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:32:48 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-aee6258c-1971-4910-be05-93a0e93daf2e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070225 Apr 12 10:32:48 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 12 10:32:48 2023] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:32:48 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2d3b5c7a-7345-4f03-ae1c-77a02be8d86d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:32:48 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2d3b5c7a-7345-4f03-ae1c-77a02be8d86d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027450 Apr 12 10:32:48 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 12 10:32:48 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:35:00 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:00 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:00 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:00 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-29d278c5-8f33-4974-96af-fb2910d9ef58 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] Action: 'create', calling method: .version_select at 0x7fabc0781630>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1973844559", "metadata": {"Type": "work"}}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:00 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-29d278c5-8f33-4974-96af-fb2910d9ef58 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] Request method failure captured: Apr 12 10:35:00 user devstack@n-api.service[61852]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 10:35:00 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:35:00 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:35:00 user devstack@n-api.service[61852]: Connection: close Apr 12 10:35:00 user devstack@n-api.service[61852]: Content-Length: 122 Apr 12 10:35:00 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:35:00 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:35:00 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:35:00 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:35:00 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNolUqBRBAwQvwOSyAbGkfkU3v3VkjtQJUjVU4sRCxd9MItieLp_5pTTheQdCaUxJDiiTZ60IPO4CPLEHv1NpEy1G0wjpv5586Fh272W1TGtYddJIf88EPiVXjCjAkevizIrUFUT-BBZomwEdLsoQkgRH1oGmzzx14Qb_xYWIVXgd_q8 Apr 12 10:35:00 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:35:00 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:35:00 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:35:00 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:35:00 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:35:00 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:35:00 user devstack@n-api.service[61852]: X-Project-Id: bf08eec98066452aab761cdfd6bf03a3 Apr 12 10:35:00 user devstack@n-api.service[61852]: X-Project-Name: tempest-VolumesNegativeTest-2133030630 Apr 12 10:35:00 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:35:00 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:35:00 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf08eec98066452aab761cdfd6bf03a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf08eec98066452aab761cdfd6bf03a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf08eec98066452aab761cdfd6bf03a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:35:00 user devstack@n-api.service[61852]: X-Tenant: tempest-VolumesNegativeTest-2133030630 Apr 12 10:35:00 user devstack@n-api.service[61852]: X-Tenant-Id: bf08eec98066452aab761cdfd6bf03a3 Apr 12 10:35:00 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-VolumesNegativeTest-2133030630 Apr 12 10:35:00 user devstack@n-api.service[61852]: X-User: tempest-VolumesNegativeTest-2133030630-project-member Apr 12 10:35:00 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:35:00 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:35:00 user devstack@n-api.service[61852]: X-User-Id: e86a4e9db10e4e02b0a886b96fce971d Apr 12 10:35:00 user devstack@n-api.service[61852]: X-User-Name: tempest-VolumesNegativeTest-2133030630-project-member Apr 12 10:35:00 user devstack@n-api.service[61852]: Apr 12 10:35:00 user devstack@n-api.service[61852]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1973844559", "metadata": {"Type": "work"}}} Apr 12 10:35:00 user devstack@n-api.service[61852]: method: Apr 12 10:35:00 user devstack@n-api.service[61852]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 10:35:00 user devstack@n-api.service[61852]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1973844559', 'metadata': {'Type': 'work'}}}} Apr 12 10:35:00 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise error Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi '#$%' Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 10:35:00 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-29d278c5-8f33-4974-96af-fb2910d9ef58 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:35:00 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-29d278c5-8f33-4974-96af-fb2910d9ef58 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.531909 Apr 12 10:35:00 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 10:35:00 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 534 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:35:00 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:00 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5e786bc1-225d-4fb8-835f-35a5e817e71c tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] Action: 'create', calling method: .version_select at 0x7fabc0791990>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1109606665", "metadata": {"Type": "work"}}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:00 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5e786bc1-225d-4fb8-835f-35a5e817e71c tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] Request method failure captured: Apr 12 10:35:00 user devstack@n-api.service[61853]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 10:35:00 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:35:00 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:35:00 user devstack@n-api.service[61853]: Connection: close Apr 12 10:35:00 user devstack@n-api.service[61853]: Content-Length: 120 Apr 12 10:35:00 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:35:00 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:35:00 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:35:00 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:35:00 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolUqBRBAwQvwOSyAbGkfkU3v3VkjtQJUjVU4sRCxd9MItieLp_5pTTheQdCaUxJDiiTZ60IPO4CPLEHv1NpEy1G0wjpv5586Fh272W1TGtYddJIf88EPiVXjCjAkevizIrUFUT-BBZomwEdLsoQkgRH1oGmzzx14Qb_xYWIVXgd_q8 Apr 12 10:35:00 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:35:00 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:35:00 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:35:00 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:35:00 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:35:00 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:35:00 user devstack@n-api.service[61853]: X-Project-Id: bf08eec98066452aab761cdfd6bf03a3 Apr 12 10:35:00 user devstack@n-api.service[61853]: X-Project-Name: tempest-VolumesNegativeTest-2133030630 Apr 12 10:35:00 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:35:00 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:35:00 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf08eec98066452aab761cdfd6bf03a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf08eec98066452aab761cdfd6bf03a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf08eec98066452aab761cdfd6bf03a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:35:00 user devstack@n-api.service[61853]: X-Tenant: tempest-VolumesNegativeTest-2133030630 Apr 12 10:35:00 user devstack@n-api.service[61853]: X-Tenant-Id: bf08eec98066452aab761cdfd6bf03a3 Apr 12 10:35:00 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-VolumesNegativeTest-2133030630 Apr 12 10:35:00 user devstack@n-api.service[61853]: X-User: tempest-VolumesNegativeTest-2133030630-project-member Apr 12 10:35:00 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:35:00 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:35:00 user devstack@n-api.service[61853]: X-User-Id: e86a4e9db10e4e02b0a886b96fce971d Apr 12 10:35:00 user devstack@n-api.service[61853]: X-User-Name: tempest-VolumesNegativeTest-2133030630-project-member Apr 12 10:35:00 user devstack@n-api.service[61853]: Apr 12 10:35:00 user devstack@n-api.service[61853]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1109606665", "metadata": {"Type": "work"}}} Apr 12 10:35:00 user devstack@n-api.service[61853]: method: Apr 12 10:35:00 user devstack@n-api.service[61853]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 10:35:00 user devstack@n-api.service[61853]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1109606665', 'metadata': {'Type': 'work'}}}} Apr 12 10:35:00 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise error Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi '0' Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 10:35:00 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5e786bc1-225d-4fb8-835f-35a5e817e71c tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:35:00 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5e786bc1-225d-4fb8-835f-35a5e817e71c tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014250 Apr 12 10:35:00 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 10:35:00 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:35:00 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0bfa86d0-6edb-4d6f-b0e5-29c1fe248049 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] Action: 'create', calling method: .version_select at 0x7fabc0781fc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-285226296", "metadata": {"Type": "work"}}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0bfa86d0-6edb-4d6f-b0e5-29c1fe248049 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] Request method failure captured: Apr 12 10:35:00 user devstack@n-api.service[61854]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 10:35:00 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:35:00 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:35:00 user devstack@n-api.service[61854]: Connection: close Apr 12 10:35:00 user devstack@n-api.service[61854]: Content-Length: 118 Apr 12 10:35:00 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:35:00 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:35:00 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:35:00 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:35:00 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNolUqBRBAwQvwOSyAbGkfkU3v3VkjtQJUjVU4sRCxd9MItieLp_5pTTheQdCaUxJDiiTZ60IPO4CPLEHv1NpEy1G0wjpv5586Fh272W1TGtYddJIf88EPiVXjCjAkevizIrUFUT-BBZomwEdLsoQkgRH1oGmzzx14Qb_xYWIVXgd_q8 Apr 12 10:35:00 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:35:00 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:35:00 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:35:00 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:35:00 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:35:00 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:35:00 user devstack@n-api.service[61854]: X-Project-Id: bf08eec98066452aab761cdfd6bf03a3 Apr 12 10:35:00 user devstack@n-api.service[61854]: X-Project-Name: tempest-VolumesNegativeTest-2133030630 Apr 12 10:35:00 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:35:00 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:35:00 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf08eec98066452aab761cdfd6bf03a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf08eec98066452aab761cdfd6bf03a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf08eec98066452aab761cdfd6bf03a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:35:00 user devstack@n-api.service[61854]: X-Tenant: tempest-VolumesNegativeTest-2133030630 Apr 12 10:35:00 user devstack@n-api.service[61854]: X-Tenant-Id: bf08eec98066452aab761cdfd6bf03a3 Apr 12 10:35:00 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-VolumesNegativeTest-2133030630 Apr 12 10:35:00 user devstack@n-api.service[61854]: X-User: tempest-VolumesNegativeTest-2133030630-project-member Apr 12 10:35:00 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:35:00 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:35:00 user devstack@n-api.service[61854]: X-User-Id: e86a4e9db10e4e02b0a886b96fce971d Apr 12 10:35:00 user devstack@n-api.service[61854]: X-User-Name: tempest-VolumesNegativeTest-2133030630-project-member Apr 12 10:35:00 user devstack@n-api.service[61854]: Apr 12 10:35:00 user devstack@n-api.service[61854]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-285226296", "metadata": {"Type": "work"}}} Apr 12 10:35:00 user devstack@n-api.service[61854]: method: Apr 12 10:35:00 user devstack@n-api.service[61854]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 10:35:00 user devstack@n-api.service[61854]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-285226296', 'metadata': {'Type': 'work'}}}} Apr 12 10:35:00 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise error Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi '' Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 10:35:00 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0bfa86d0-6edb-4d6f-b0e5-29c1fe248049 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:35:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-0bfa86d0-6edb-4d6f-b0e5-29c1fe248049 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018091 Apr 12 10:35:00 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 10:35:00 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:35:00 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e93a1b65-3b90-4aed-8397-a3c4a3dba513 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] Calling method '.version_select at 0x7fabc062c0d0>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:00 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-9147b3c8-61b5-4a1c-be2d-1bb8dafbd9a2 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Action: 'create', calling method: .version_select at 0x7fabc11b1ab0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1114477982"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-e93a1b65-3b90-4aed-8397-a3c4a3dba513 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] HTTP exception thrown: Volume tempest-invalid-1978135238 could not be found. Apr 12 10:35:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e93a1b65-3b90-4aed-8397-a3c4a3dba513 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] Request method failure captured: Apr 12 10:35:01 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1978135238 HTTP/1.1 Apr 12 10:35:01 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:35:01 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:35:01 user devstack@n-api.service[61853]: Connection: close Apr 12 10:35:01 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:35:01 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:35:01 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:35:01 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:35:01 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolUqBRBAwQvwOSyAbGkfkU3v3VkjtQJUjVU4sRCxd9MItieLp_5pTTheQdCaUxJDiiTZ60IPO4CPLEHv1NpEy1G0wjpv5586Fh272W1TGtYddJIf88EPiVXjCjAkevizIrUFUT-BBZomwEdLsoQkgRH1oGmzzx14Qb_xYWIVXgd_q8 Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Project-Id: bf08eec98066452aab761cdfd6bf03a3 Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Project-Name: tempest-VolumesNegativeTest-2133030630 Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf08eec98066452aab761cdfd6bf03a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf08eec98066452aab761cdfd6bf03a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf08eec98066452aab761cdfd6bf03a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Tenant: tempest-VolumesNegativeTest-2133030630 Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Tenant-Id: bf08eec98066452aab761cdfd6bf03a3 Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-VolumesNegativeTest-2133030630 Apr 12 10:35:01 user devstack@n-api.service[61853]: X-User: tempest-VolumesNegativeTest-2133030630-project-member Apr 12 10:35:01 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:35:01 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:35:01 user devstack@n-api.service[61853]: X-User-Id: e86a4e9db10e4e02b0a886b96fce971d Apr 12 10:35:01 user devstack@n-api.service[61853]: X-User-Name: tempest-VolumesNegativeTest-2133030630-project-member Apr 12 10:35:01 user devstack@n-api.service[61853]: method: Apr 12 10:35:01 user devstack@n-api.service[61853]: exception: Volume tempest-invalid-1978135238 could not be found. Apr 12 10:35:01 user devstack@n-api.service[61853]: action_args: {'id': 'tempest-invalid-1978135238'} Apr 12 10:35:01 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1978135238 could not be found. (HTTP 404) (Request-ID: req-8df89c72-7aa1-4aeb-b23d-50530a47d5d9) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1978135238 could not be found. Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1978135238 could not be found. Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1978135238 could not be found. Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e93a1b65-3b90-4aed-8397-a3c4a3dba513 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] Returning 404 to user: Volume tempest-invalid-1978135238 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:35:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-e93a1b65-3b90-4aed-8397-a3c4a3dba513 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1978135238" status: 404 len: 99 microversion: 2.1 time: 0.391262 Apr 12 10:35:01 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 18/49] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 10:35:00 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1978135238 => generated 99 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 12 10:35:01 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-66e869a2-bf83-4a28-b534-1876eaa2b159 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007225 Apr 12 10:35:01 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 17/50] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 12 10:35:01 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 10:35:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-135fb4a2-1a52-4d10-9124-54e144638cc6 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004384 Apr 12 10:35:01 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 19/51] 10.0.0.210 () {62 vars in 1214 bytes} [Wed Apr 12 10:35:01 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 10:35:01 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a4c9f379-801c-4f23-a71d-bc20c98d02ff tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] Calling method '.version_select at 0x7fabc07815a0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:01 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-a4c9f379-801c-4f23-a71d-bc20c98d02ff tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] HTTP exception thrown: Volume 2210ccdb-64fe-485d-a7d4-400abec48298 could not be found. Apr 12 10:35:01 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a4c9f379-801c-4f23-a71d-bc20c98d02ff tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] Request method failure captured: Apr 12 10:35:01 user devstack@n-api.service[61854]: request: DELETE /compute/v2.1/os-volumes/2210ccdb-64fe-485d-a7d4-400abec48298 HTTP/1.1 Apr 12 10:35:01 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:35:01 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:35:01 user devstack@n-api.service[61854]: Connection: close Apr 12 10:35:01 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:35:01 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:35:01 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:35:01 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:35:01 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:35:01 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNolUqBRBAwQvwOSyAbGkfkU3v3VkjtQJUjVU4sRCxd9MItieLp_5pTTheQdCaUxJDiiTZ60IPO4CPLEHv1NpEy1G0wjpv5586Fh272W1TGtYddJIf88EPiVXjCjAkevizIrUFUT-BBZomwEdLsoQkgRH1oGmzzx14Qb_xYWIVXgd_q8 Apr 12 10:35:01 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:35:01 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:35:01 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:35:01 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:35:01 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:35:01 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:35:01 user devstack@n-api.service[61854]: X-Project-Id: bf08eec98066452aab761cdfd6bf03a3 Apr 12 10:35:01 user devstack@n-api.service[61854]: X-Project-Name: tempest-VolumesNegativeTest-2133030630 Apr 12 10:35:01 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:35:01 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:35:01 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf08eec98066452aab761cdfd6bf03a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf08eec98066452aab761cdfd6bf03a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf08eec98066452aab761cdfd6bf03a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:35:01 user devstack@n-api.service[61854]: X-Tenant: tempest-VolumesNegativeTest-2133030630 Apr 12 10:35:01 user devstack@n-api.service[61854]: X-Tenant-Id: bf08eec98066452aab761cdfd6bf03a3 Apr 12 10:35:01 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-VolumesNegativeTest-2133030630 Apr 12 10:35:01 user devstack@n-api.service[61854]: X-User: tempest-VolumesNegativeTest-2133030630-project-member Apr 12 10:35:01 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:35:01 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:35:01 user devstack@n-api.service[61854]: X-User-Id: e86a4e9db10e4e02b0a886b96fce971d Apr 12 10:35:01 user devstack@n-api.service[61854]: X-User-Name: tempest-VolumesNegativeTest-2133030630-project-member Apr 12 10:35:01 user devstack@n-api.service[61854]: method: Apr 12 10:35:01 user devstack@n-api.service[61854]: exception: Volume 2210ccdb-64fe-485d-a7d4-400abec48298 could not be found. Apr 12 10:35:01 user devstack@n-api.service[61854]: action_args: {'id': '2210ccdb-64fe-485d-a7d4-400abec48298'} Apr 12 10:35:01 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2210ccdb-64fe-485d-a7d4-400abec48298 could not be found. (HTTP 404) (Request-ID: req-ff6e8257-fb75-4497-9dcc-2643ce263284) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2210ccdb-64fe-485d-a7d4-400abec48298 could not be found. Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2210ccdb-64fe-485d-a7d4-400abec48298 could not be found. Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2210ccdb-64fe-485d-a7d4-400abec48298 could not be found. Apr 12 10:35:01 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a4c9f379-801c-4f23-a71d-bc20c98d02ff tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] Returning 404 to user: Volume 2210ccdb-64fe-485d-a7d4-400abec48298 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:35:01 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a4c9f379-801c-4f23-a71d-bc20c98d02ff tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/2210ccdb-64fe-485d-a7d4-400abec48298" status: 404 len: 109 microversion: 2.1 time: 0.221609 Apr 12 10:35:01 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 18/52] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 10:35:01 2023] DELETE /compute/v2.1/os-volumes/2210ccdb-64fe-485d-a7d4-400abec48298 => generated 109 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:35:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-30a70e84-6765-4cec-b1ef-ed41509152d7 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] Calling method '.version_select at 0x7fabc06817e0>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-30a70e84-6765-4cec-b1ef-ed41509152d7 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] HTTP exception thrown: Volume 94c194a3-7dac-44ed-885a-d75ab794ae78 could not be found. Apr 12 10:35:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-30a70e84-6765-4cec-b1ef-ed41509152d7 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] Request method failure captured: Apr 12 10:35:01 user devstack@n-api.service[61853]: request: GET /compute/v2.1/os-volumes/94c194a3-7dac-44ed-885a-d75ab794ae78 HTTP/1.1 Apr 12 10:35:01 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:35:01 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:35:01 user devstack@n-api.service[61853]: Connection: close Apr 12 10:35:01 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:35:01 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:35:01 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:35:01 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:35:01 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolUqBRBAwQvwOSyAbGkfkU3v3VkjtQJUjVU4sRCxd9MItieLp_5pTTheQdCaUxJDiiTZ60IPO4CPLEHv1NpEy1G0wjpv5586Fh272W1TGtYddJIf88EPiVXjCjAkevizIrUFUT-BBZomwEdLsoQkgRH1oGmzzx14Qb_xYWIVXgd_q8 Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Project-Id: bf08eec98066452aab761cdfd6bf03a3 Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Project-Name: tempest-VolumesNegativeTest-2133030630 Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf08eec98066452aab761cdfd6bf03a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf08eec98066452aab761cdfd6bf03a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf08eec98066452aab761cdfd6bf03a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Tenant: tempest-VolumesNegativeTest-2133030630 Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Tenant-Id: bf08eec98066452aab761cdfd6bf03a3 Apr 12 10:35:01 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-VolumesNegativeTest-2133030630 Apr 12 10:35:01 user devstack@n-api.service[61853]: X-User: tempest-VolumesNegativeTest-2133030630-project-member Apr 12 10:35:01 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:35:01 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:35:01 user devstack@n-api.service[61853]: X-User-Id: e86a4e9db10e4e02b0a886b96fce971d Apr 12 10:35:01 user devstack@n-api.service[61853]: X-User-Name: tempest-VolumesNegativeTest-2133030630-project-member Apr 12 10:35:01 user devstack@n-api.service[61853]: method: Apr 12 10:35:01 user devstack@n-api.service[61853]: exception: Volume 94c194a3-7dac-44ed-885a-d75ab794ae78 could not be found. Apr 12 10:35:01 user devstack@n-api.service[61853]: action_args: {'id': '94c194a3-7dac-44ed-885a-d75ab794ae78'} Apr 12 10:35:01 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94c194a3-7dac-44ed-885a-d75ab794ae78 could not be found. (HTTP 404) (Request-ID: req-dbf57cd5-c257-44e6-a8af-fd58080e7038) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94c194a3-7dac-44ed-885a-d75ab794ae78 could not be found. Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94c194a3-7dac-44ed-885a-d75ab794ae78 could not be found. Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94c194a3-7dac-44ed-885a-d75ab794ae78 could not be found. Apr 12 10:35:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-30a70e84-6765-4cec-b1ef-ed41509152d7 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] Returning 404 to user: Volume 94c194a3-7dac-44ed-885a-d75ab794ae78 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:35:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-30a70e84-6765-4cec-b1ef-ed41509152d7 tempest-VolumesNegativeTest-2133030630 tempest-VolumesNegativeTest-2133030630-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/94c194a3-7dac-44ed-885a-d75ab794ae78" status: 404 len: 109 microversion: 2.1 time: 0.050128 Apr 12 10:35:01 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 20/53] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 10:35:01 2023] GET /compute/v2.1/os-volumes/94c194a3-7dac-44ed-885a-d75ab794ae78 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:35:02 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-9147b3c8-61b5-4a1c-be2d-1bb8dafbd9a2 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.465385 Apr 12 10:35:02 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 16/54] 10.0.0.210 () {64 vars in 1232 bytes} [Wed Apr 12 10:35:00 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 1467 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 12 10:35:02 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3cc4a0ac-2ff4-4d85-8606-1cc224d668ba tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Calling method '.version_select at 0x7fabc06a8790>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-3cc4a0ac-2ff4-4d85-8606-1cc224d668ba tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae" status: 200 len: 345 microversion: 2.1 time: 0.100306 Apr 12 10:35:02 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 19/55] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 10:35:02 2023] GET /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae => generated 345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:03 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3430bf28-6a3d-49fd-8a19-43635e902335 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Calling method '.version_select at 0x7fabc0681870>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:03 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-3430bf28-6a3d-49fd-8a19-43635e902335 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae" status: 200 len: 346 microversion: 2.1 time: 0.057365 Apr 12 10:35:03 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 21/56] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 10:35:03 2023] GET /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:03 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-4256669c-b591-466c-8239-7dd0c5ed331a tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Action: 'create', calling method: .version_select at 0x7fabc0661000>, body: {"snapshot": {"volume_id": "44e830a1-c6bd-413a-9efd-21ec94f93bae", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1561041362"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:03 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-4256669c-b591-466c-8239-7dd0c5ed331a tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.287561 Apr 12 10:35:03 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 17/57] 10.0.0.210 () {64 vars in 1239 bytes} [Wed Apr 12 10:35:03 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0c1e8022-b63a-4666-b27a-4ab8f701e0fe tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Calling method '.version_select at 0x7fabc06a8700>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-0c1e8022-b63a-4666-b27a-4ab8f701e0fe tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/211bb998-7cfb-41e6-b149-f06bd11ee1d2" status: 200 len: 287 microversion: 2.1 time: 0.067664 Apr 12 10:35:03 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 20/58] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 10:35:03 2023] GET /compute/v2.1/os-snapshots/211bb998-7cfb-41e6-b149-f06bd11ee1d2 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:03 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4d872cc6-849f-4a32-9b46-c7f1172b452e tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Calling method '.version_select at 0x7fabc0681c60>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:04 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-4d872cc6-849f-4a32-9b46-c7f1172b452e tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.215599 Apr 12 10:35:04 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 22/59] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 12 10:35:03 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:04 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-05bf6596-ddd3-4468-95a7-65eefdfdf3f6 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Calling method '.version_select at 0x7fabc0662290>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:04 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-05bf6596-ddd3-4468-95a7-65eefdfdf3f6 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/211bb998-7cfb-41e6-b149-f06bd11ee1d2" status: 200 len: 287 microversion: 2.1 time: 0.088801 Apr 12 10:35:04 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 18/60] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 10:35:04 2023] GET /compute/v2.1/os-snapshots/211bb998-7cfb-41e6-b149-f06bd11ee1d2 => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-4bb22387-f9ce-43f9-a57d-677ad0dab837 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Calling method '.version_select at 0x7fabc06a8c10>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-4bb22387-f9ce-43f9-a57d-677ad0dab837 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/211bb998-7cfb-41e6-b149-f06bd11ee1d2" status: 200 len: 288 microversion: 2.1 time: 0.040782 Apr 12 10:35:05 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 21/61] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 10:35:05 2023] GET /compute/v2.1/os-snapshots/211bb998-7cfb-41e6-b149-f06bd11ee1d2 => generated 288 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:05 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-76695e0c-1cea-4463-b4d1-295b115cb353 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Calling method '.version_select at 0x7fabc0682b00>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-76695e0c-1cea-4463-b4d1-295b115cb353 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/211bb998-7cfb-41e6-b149-f06bd11ee1d2" status: 202 len: 0 microversion: 2.1 time: 0.095549 Apr 12 10:35:05 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 23/62] 10.0.0.210 () {62 vars in 1331 bytes} [Wed Apr 12 10:35:05 2023] DELETE /compute/v2.1/os-snapshots/211bb998-7cfb-41e6-b149-f06bd11ee1d2 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:35:05 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-8b3be78a-e3be-445b-8562-43d3ee8624ee tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Calling method '.version_select at 0x7fabc06625f0>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:05 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-8b3be78a-e3be-445b-8562-43d3ee8624ee tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/211bb998-7cfb-41e6-b149-f06bd11ee1d2" status: 200 len: 287 microversion: 2.1 time: 0.034502 Apr 12 10:35:05 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 19/63] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 10:35:05 2023] GET /compute/v2.1/os-snapshots/211bb998-7cfb-41e6-b149-f06bd11ee1d2 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ab548d56-0444-49e3-a087-fa6640070f1d tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Calling method '.version_select at 0x7fabc06a92d0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ab548d56-0444-49e3-a087-fa6640070f1d tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/211bb998-7cfb-41e6-b149-f06bd11ee1d2" status: 200 len: 287 microversion: 2.1 time: 0.040404 Apr 12 10:35:06 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 22/64] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 10:35:06 2023] GET /compute/v2.1/os-snapshots/211bb998-7cfb-41e6-b149-f06bd11ee1d2 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-865acc36-0b1f-4f80-9f26-d5c0c979a377 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Calling method '.version_select at 0x7fabc0682440>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-865acc36-0b1f-4f80-9f26-d5c0c979a377 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] HTTP exception thrown: Snapshot 211bb998-7cfb-41e6-b149-f06bd11ee1d2 could not be found. Apr 12 10:35:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-865acc36-0b1f-4f80-9f26-d5c0c979a377 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Request method failure captured: Apr 12 10:35:07 user devstack@n-api.service[61853]: request: GET /compute/v2.1/os-snapshots/211bb998-7cfb-41e6-b149-f06bd11ee1d2 HTTP/1.1 Apr 12 10:35:07 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:35:07 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:35:07 user devstack@n-api.service[61853]: Connection: close Apr 12 10:35:07 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:35:07 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:35:07 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:35:07 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:35:07 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:35:07 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolUCtENiAcb96KsXJ_Vf4-Pof0JPNJCh-OId6GSdKeCFB_9RKGyIZfMjhrjSy1SztEAJCFuyj7CGd8I1PJ7UmVBm7-aYJ5QZKw_LDJBmqhcE9hbUWsLtZ9eaWSdvQokhDnDIqcPECF-5Bq5p5irbhylg8TPW6tNFnqvgXk6_hCqY4A Apr 12 10:35:07 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:35:07 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:35:07 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:35:07 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:35:07 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:35:07 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:35:07 user devstack@n-api.service[61853]: X-Project-Id: ef5cec2320c24a9cb4f2461e68dd57df Apr 12 10:35:07 user devstack@n-api.service[61853]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-277392170 Apr 12 10:35:07 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:35:07 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:35:07 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ef5cec2320c24a9cb4f2461e68dd57df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef5cec2320c24a9cb4f2461e68dd57df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef5cec2320c24a9cb4f2461e68dd57df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:35:07 user devstack@n-api.service[61853]: X-Tenant: tempest-VolumesSnapshotsTestJSON-277392170 Apr 12 10:35:07 user devstack@n-api.service[61853]: X-Tenant-Id: ef5cec2320c24a9cb4f2461e68dd57df Apr 12 10:35:07 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-277392170 Apr 12 10:35:07 user devstack@n-api.service[61853]: X-User: tempest-VolumesSnapshotsTestJSON-277392170-project-member Apr 12 10:35:07 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:35:07 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:35:07 user devstack@n-api.service[61853]: X-User-Id: 7d60b987fbbb48d897e2af398e4d3576 Apr 12 10:35:07 user devstack@n-api.service[61853]: X-User-Name: tempest-VolumesSnapshotsTestJSON-277392170-project-member Apr 12 10:35:07 user devstack@n-api.service[61853]: method: Apr 12 10:35:07 user devstack@n-api.service[61853]: exception: Snapshot 211bb998-7cfb-41e6-b149-f06bd11ee1d2 could not be found. Apr 12 10:35:07 user devstack@n-api.service[61853]: action_args: {'id': '211bb998-7cfb-41e6-b149-f06bd11ee1d2'} Apr 12 10:35:07 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 211bb998-7cfb-41e6-b149-f06bd11ee1d2 could not be found. (HTTP 404) (Request-ID: req-9674aac2-af89-4ba3-92c6-754ecb3b9ba3) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 211bb998-7cfb-41e6-b149-f06bd11ee1d2 could not be found. Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 211bb998-7cfb-41e6-b149-f06bd11ee1d2 could not be found. Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 211bb998-7cfb-41e6-b149-f06bd11ee1d2 could not be found. Apr 12 10:35:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-865acc36-0b1f-4f80-9f26-d5c0c979a377 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Returning 404 to user: Snapshot 211bb998-7cfb-41e6-b149-f06bd11ee1d2 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:35:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-865acc36-0b1f-4f80-9f26-d5c0c979a377 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/211bb998-7cfb-41e6-b149-f06bd11ee1d2" status: 404 len: 111 microversion: 2.1 time: 0.033609 Apr 12 10:35:07 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 24/65] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 10:35:07 2023] GET /compute/v2.1/os-snapshots/211bb998-7cfb-41e6-b149-f06bd11ee1d2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:35:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-fae10e37-3d42-41cf-bd21-7c672d804d5c tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Calling method '.version_select at 0x7fabc0661ea0>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:07 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-fae10e37-3d42-41cf-bd21-7c672d804d5c tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae" status: 202 len: 0 microversion: 2.1 time: 0.065275 Apr 12 10:35:07 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 20/66] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 10:35:07 2023] DELETE /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:35:07 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3fffcd5a-c416-4fd1-ac0c-c35dd65725fd tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Calling method '.version_select at 0x7fabc06a96c0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:07 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-3fffcd5a-c416-4fd1-ac0c-c35dd65725fd tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae" status: 200 len: 345 microversion: 2.1 time: 0.050789 Apr 12 10:35:07 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 23/67] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 10:35:07 2023] GET /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-772245965", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:07 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] validate_networks() for None {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:35:08 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-b719600d-71ed-414b-b83e-8db3182fc985 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Calling method '.version_select at 0x7fabc06617e0>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:08 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-b719600d-71ed-414b-b83e-8db3182fc985 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae" status: 200 len: 345 microversion: 2.1 time: 0.053029 Apr 12 10:35:08 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 21/68] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 10:35:08 2023] GET /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:08 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:35:08 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:35:08 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:35:08 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:35:08 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:35:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:08 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Getting quotas for project 3d8cbfbed2c843f796e810c6cc8530ba. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:35:08 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Getting quotas for user 064f86e997904027aa9f086e3b137916 and project 3d8cbfbed2c843f796e810c6cc8530ba. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:35:08 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:35:08 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:35:08 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.065598 Apr 12 10:35:08 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 25/69] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:35:07 2023] POST /compute/v2.1/servers => generated 378 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:35:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-86fa4abe-73bd-4e09-86ed-b678bbfce388 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:08 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-86fa4abe-73bd-4e09-86ed-b678bbfce388 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:35:09 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-86fa4abe-73bd-4e09-86ed-b678bbfce388 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064f86e997904027aa9f086e3b137916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8cbfbed2c843f796e810c6cc8530ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:35:09 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-86fa4abe-73bd-4e09-86ed-b678bbfce388 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] 10.0.0.210 "GET /compute/v2.1/servers/270d5d4d-4df6-4ba5-9145-98f343fb3b0e" status: 200 len: 1208 microversion: 2.1 time: 0.158084 Apr 12 10:35:09 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 24/70] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:35:08 2023] GET /compute/v2.1/servers/270d5d4d-4df6-4ba5-9145-98f343fb3b0e => generated 1208 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:35:09 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-8465760b-477b-460d-82cb-a9871b2333f4 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Calling method '.version_select at 0x7fabc06613f0>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:09 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-8465760b-477b-460d-82cb-a9871b2333f4 tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae" status: 200 len: 345 microversion: 2.1 time: 0.051058 Apr 12 10:35:09 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 22/71] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 10:35:09 2023] GET /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:10 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c34994ec-8313-495e-9aab-969e583825dc tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Calling method '.version_select at 0x7fabc056b2e0>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:10 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-c34994ec-8313-495e-9aab-969e583825dc tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] HTTP exception thrown: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. Apr 12 10:35:10 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c34994ec-8313-495e-9aab-969e583825dc tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Request method failure captured: Apr 12 10:35:10 user devstack@n-api.service[61853]: request: GET /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae HTTP/1.1 Apr 12 10:35:10 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:35:10 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:35:10 user devstack@n-api.service[61853]: Connection: close Apr 12 10:35:10 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:35:10 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:35:10 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:35:10 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:35:10 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:35:10 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolUCtENiAcb96KsXJ_Vf4-Pof0JPNJCh-OId6GSdKeCFB_9RKGyIZfMjhrjSy1SztEAJCFuyj7CGd8I1PJ7UmVBm7-aYJ5QZKw_LDJBmqhcE9hbUWsLtZ9eaWSdvQokhDnDIqcPECF-5Bq5p5irbhylg8TPW6tNFnqvgXk6_hCqY4A Apr 12 10:35:10 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:35:10 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:35:10 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:35:10 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:35:10 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:35:10 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:35:10 user devstack@n-api.service[61853]: X-Project-Id: ef5cec2320c24a9cb4f2461e68dd57df Apr 12 10:35:10 user devstack@n-api.service[61853]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-277392170 Apr 12 10:35:10 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:35:10 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:35:10 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ef5cec2320c24a9cb4f2461e68dd57df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef5cec2320c24a9cb4f2461e68dd57df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef5cec2320c24a9cb4f2461e68dd57df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:35:10 user devstack@n-api.service[61853]: X-Tenant: tempest-VolumesSnapshotsTestJSON-277392170 Apr 12 10:35:10 user devstack@n-api.service[61853]: X-Tenant-Id: ef5cec2320c24a9cb4f2461e68dd57df Apr 12 10:35:10 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-277392170 Apr 12 10:35:10 user devstack@n-api.service[61853]: X-User: tempest-VolumesSnapshotsTestJSON-277392170-project-member Apr 12 10:35:10 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:35:10 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:35:10 user devstack@n-api.service[61853]: X-User-Id: 7d60b987fbbb48d897e2af398e4d3576 Apr 12 10:35:10 user devstack@n-api.service[61853]: X-User-Name: tempest-VolumesSnapshotsTestJSON-277392170-project-member Apr 12 10:35:10 user devstack@n-api.service[61853]: method: Apr 12 10:35:10 user devstack@n-api.service[61853]: exception: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. Apr 12 10:35:10 user devstack@n-api.service[61853]: action_args: {'id': '44e830a1-c6bd-413a-9efd-21ec94f93bae'} Apr 12 10:35:10 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. (HTTP 404) (Request-ID: req-6e9d9a99-146f-474e-aaf3-a97388e9779d) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. Apr 12 10:35:10 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c34994ec-8313-495e-9aab-969e583825dc tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Returning 404 to user: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:35:10 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c34994ec-8313-495e-9aab-969e583825dc tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae" status: 404 len: 109 microversion: 2.1 time: 0.047274 Apr 12 10:35:10 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 26/72] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 10:35:10 2023] GET /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:35:10 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7f53c2a5-73b9-480c-b315-d73c1183624d tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Calling method '.version_select at 0x7fabc06aa560>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-7f53c2a5-73b9-480c-b315-d73c1183624d tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] HTTP exception thrown: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. Apr 12 10:35:10 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7f53c2a5-73b9-480c-b315-d73c1183624d tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Request method failure captured: Apr 12 10:35:10 user devstack@n-api.service[61854]: request: DELETE /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae HTTP/1.1 Apr 12 10:35:10 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:35:10 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:35:10 user devstack@n-api.service[61854]: Connection: close Apr 12 10:35:10 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:35:10 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:35:10 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:35:10 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:35:10 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:35:10 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNolUCtENiAcb96KsXJ_Vf4-Pof0JPNJCh-OId6GSdKeCFB_9RKGyIZfMjhrjSy1SztEAJCFuyj7CGd8I1PJ7UmVBm7-aYJ5QZKw_LDJBmqhcE9hbUWsLtZ9eaWSdvQokhDnDIqcPECF-5Bq5p5irbhylg8TPW6tNFnqvgXk6_hCqY4A Apr 12 10:35:10 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:35:10 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:35:10 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:35:10 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:35:10 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:35:10 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:35:10 user devstack@n-api.service[61854]: X-Project-Id: ef5cec2320c24a9cb4f2461e68dd57df Apr 12 10:35:10 user devstack@n-api.service[61854]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-277392170 Apr 12 10:35:10 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:35:10 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:35:10 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ef5cec2320c24a9cb4f2461e68dd57df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef5cec2320c24a9cb4f2461e68dd57df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef5cec2320c24a9cb4f2461e68dd57df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:35:10 user devstack@n-api.service[61854]: X-Tenant: tempest-VolumesSnapshotsTestJSON-277392170 Apr 12 10:35:10 user devstack@n-api.service[61854]: X-Tenant-Id: ef5cec2320c24a9cb4f2461e68dd57df Apr 12 10:35:10 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-277392170 Apr 12 10:35:10 user devstack@n-api.service[61854]: X-User: tempest-VolumesSnapshotsTestJSON-277392170-project-member Apr 12 10:35:10 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:35:10 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:35:10 user devstack@n-api.service[61854]: X-User-Id: 7d60b987fbbb48d897e2af398e4d3576 Apr 12 10:35:10 user devstack@n-api.service[61854]: X-User-Name: tempest-VolumesSnapshotsTestJSON-277392170-project-member Apr 12 10:35:10 user devstack@n-api.service[61854]: method: Apr 12 10:35:10 user devstack@n-api.service[61854]: exception: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. Apr 12 10:35:10 user devstack@n-api.service[61854]: action_args: {'id': '44e830a1-c6bd-413a-9efd-21ec94f93bae'} Apr 12 10:35:10 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. (HTTP 404) (Request-ID: req-584b6c4b-5465-40cd-a5d4-4f54ec93f313) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. Apr 12 10:35:10 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7f53c2a5-73b9-480c-b315-d73c1183624d tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Returning 404 to user: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:35:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-7f53c2a5-73b9-480c-b315-d73c1183624d tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae" status: 404 len: 109 microversion: 2.1 time: 0.040716 Apr 12 10:35:10 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 25/73] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 10:35:10 2023] DELETE /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:35:10 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-8acb6377-c109-4a0a-a0ba-a1e6a8ce780b tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Calling method '.version_select at 0x7fabc0661c60>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:10 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-8acb6377-c109-4a0a-a0ba-a1e6a8ce780b tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] HTTP exception thrown: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. Apr 12 10:35:10 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-8acb6377-c109-4a0a-a0ba-a1e6a8ce780b tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Request method failure captured: Apr 12 10:35:10 user devstack@n-api.service[61852]: request: GET /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae HTTP/1.1 Apr 12 10:35:10 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:35:10 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:35:10 user devstack@n-api.service[61852]: Connection: close Apr 12 10:35:10 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:35:10 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:35:10 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:35:10 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:35:10 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:35:10 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNolUCtENiAcb96KsXJ_Vf4-Pof0JPNJCh-OId6GSdKeCFB_9RKGyIZfMjhrjSy1SztEAJCFuyj7CGd8I1PJ7UmVBm7-aYJ5QZKw_LDJBmqhcE9hbUWsLtZ9eaWSdvQokhDnDIqcPECF-5Bq5p5irbhylg8TPW6tNFnqvgXk6_hCqY4A Apr 12 10:35:10 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:35:10 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:35:10 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:35:10 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:35:10 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:35:10 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:35:10 user devstack@n-api.service[61852]: X-Project-Id: ef5cec2320c24a9cb4f2461e68dd57df Apr 12 10:35:10 user devstack@n-api.service[61852]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-277392170 Apr 12 10:35:10 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:35:10 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:35:10 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ef5cec2320c24a9cb4f2461e68dd57df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef5cec2320c24a9cb4f2461e68dd57df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef5cec2320c24a9cb4f2461e68dd57df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:35:10 user devstack@n-api.service[61852]: X-Tenant: tempest-VolumesSnapshotsTestJSON-277392170 Apr 12 10:35:10 user devstack@n-api.service[61852]: X-Tenant-Id: ef5cec2320c24a9cb4f2461e68dd57df Apr 12 10:35:10 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-277392170 Apr 12 10:35:10 user devstack@n-api.service[61852]: X-User: tempest-VolumesSnapshotsTestJSON-277392170-project-member Apr 12 10:35:10 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:35:10 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:35:10 user devstack@n-api.service[61852]: X-User-Id: 7d60b987fbbb48d897e2af398e4d3576 Apr 12 10:35:10 user devstack@n-api.service[61852]: X-User-Name: tempest-VolumesSnapshotsTestJSON-277392170-project-member Apr 12 10:35:10 user devstack@n-api.service[61852]: method: Apr 12 10:35:10 user devstack@n-api.service[61852]: exception: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. Apr 12 10:35:10 user devstack@n-api.service[61852]: action_args: {'id': '44e830a1-c6bd-413a-9efd-21ec94f93bae'} Apr 12 10:35:10 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. (HTTP 404) (Request-ID: req-1b369fbc-d0bc-48e1-bcb3-82f0638c1f7a) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. Apr 12 10:35:10 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:35:10 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-8acb6377-c109-4a0a-a0ba-a1e6a8ce780b tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] Returning 404 to user: Volume 44e830a1-c6bd-413a-9efd-21ec94f93bae could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:35:10 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-8acb6377-c109-4a0a-a0ba-a1e6a8ce780b tempest-VolumesSnapshotsTestJSON-277392170 tempest-VolumesSnapshotsTestJSON-277392170-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae" status: 404 len: 109 microversion: 2.1 time: 0.052474 Apr 12 10:35:10 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 23/74] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 10:35:10 2023] GET /compute/v2.1/os-volumes/44e830a1-c6bd-413a-9efd-21ec94f93bae => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:35:19 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:19 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:19 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:19 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:19 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:19 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-334bd9ba-333e-40d3-b499-162a68df07d8 req-2ae43a3c-39d0-4577-b473-b383bd3fbb1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "270d5d4d-4df6-4ba5-9145-98f343fb3b0e", "tag": "42768d69-c7da-43fb-b092-c5b41ac2d55c"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-334bd9ba-333e-40d3-b499-162a68df07d8 req-2ae43a3c-39d0-4577-b473-b383bd3fbb1c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-334bd9ba-333e-40d3-b499-162a68df07d8 req-2ae43a3c-39d0-4577-b473-b383bd3fbb1c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-334bd9ba-333e-40d3-b499-162a68df07d8 req-2ae43a3c-39d0-4577-b473-b383bd3fbb1c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:19 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:19 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-35b4d660-6647-4856-aaf4-cd6af6d6309d tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Action: 'create', calling method: .version_select at 0x7fabc11b12d0>, body: {"keypair": {"name": "tempest-keypair-1241183546", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA=="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-334bd9ba-333e-40d3-b499-162a68df07d8 req-2ae43a3c-39d0-4577-b473-b383bd3fbb1c service nova] Creating event network-changed:42768d69-c7da-43fb-b092-c5b41ac2d55c for instance 270d5d4d-4df6-4ba5-9145-98f343fb3b0e on user Apr 12 10:35:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-334bd9ba-333e-40d3-b499-162a68df07d8 req-2ae43a3c-39d0-4577-b473-b383bd3fbb1c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61853) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 10:35:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-334bd9ba-333e-40d3-b499-162a68df07d8 req-2ae43a3c-39d0-4577-b473-b383bd3fbb1c service nova] Acquired lock "compute-rpcapi-router" {{(pid=61853) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 10:35:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8fb1e3ec-cc6c-43e9-897f-1e838c28a2c2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8fb1e3ec-cc6c-43e9-897f-1e838c28a2c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8fb1e3ec-cc6c-43e9-897f-1e838c28a2c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8fb1e3ec-cc6c-43e9-897f-1e838c28a2c2 None None] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8fb1e3ec-cc6c-43e9-897f-1e838c28a2c2 None None] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8fb1e3ec-cc6c-43e9-897f-1e838c28a2c2 None None] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:19 user devstack@n-api.service[61853]: INFO nova.compute.rpcapi [None req-8fb1e3ec-cc6c-43e9-897f-1e838c28a2c2 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 10:35:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8fb1e3ec-cc6c-43e9-897f-1e838c28a2c2 None None] Releasing lock "compute-rpcapi-router" {{(pid=61853) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 10:35:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8fb1e3ec-cc6c-43e9-897f-1e838c28a2c2 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192877 Apr 12 10:35:19 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 27/75] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:35:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:19 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-35b4d660-6647-4856-aaf4-cd6af6d6309d tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting quotas for project 32235c67d269474b879a58269c1bfb28. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:35:19 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-35b4d660-6647-4856-aaf4-cd6af6d6309d tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting quotas for user 0059d31539304ffcb5214b408751cd4f and project 32235c67d269474b879a58269c1bfb28. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:35:19 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-35b4d660-6647-4856-aaf4-cd6af6d6309d tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.186458 Apr 12 10:35:19 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 26/76] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 10:35:19 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:21 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-ad088240-273f-4b29-b58e-ddcc795d1f6c tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Action: 'create', calling method: .version_select at 0x7fabc0660e50>, body: {"keypair": {"name": "tempest-keypair-1741756118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6J/cK5G69Rc1hFnFymuRzf/sxnh8tJeZCIsgDUrpU33tRNE8M9FW28e93IetT70vO+0CYZlhg4APAc6iRcEFv6hlCiC5vyIOseX+/85okbnJjZIoECICRAjLKoMj3fbA=="}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:21 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-ad088240-273f-4b29-b58e-ddcc795d1f6c tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Getting quotas for project 8ce2a3bde13e464f8df0a41f30c240ab. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:35:21 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-ad088240-273f-4b29-b58e-ddcc795d1f6c tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Getting quotas for user c757f04065b9488ba75739e59d7be377 and project 8ce2a3bde13e464f8df0a41f30c240ab. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:35:21 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-ad088240-273f-4b29-b58e-ddcc795d1f6c tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.217566 Apr 12 10:35:21 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 24/77] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 10:35:21 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-386378272", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "networks": [{"uuid": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e"}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:22 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] validate_networks() for [('49a2fb41-5e5e-4d4b-969a-0043778b4b0e', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:35:23 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1895953867", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f246d51a-9d0f-483e-858e-7f71be8b6085"}], "security_groups": [{"name": "tempest-securitygroup--2109462499"}], "key_name": "tempest-keypair-1241183546", "user_data": "}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:24 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] validate_networks() for [('f246d51a-9d0f-483e-858e-7f71be8b6085', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:35:24 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:35:24 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:35:24 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:35:24 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:35:24 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:35:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:24 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Getting quotas for project 3789b59ccc704f86afac83af21fd84f9. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:35:24 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Getting quotas for user ba49b947c74e48f3b161b6f9fce8b1c5 and project 3789b59ccc704f86afac83af21fd84f9. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:35:24 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:35:24 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:35:24 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 2.276214 Apr 12 10:35:24 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 28/78] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 10:35:22 2023] POST /compute/v2.1/servers => generated 378 bytes in 2279 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 10:35:24 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-ccd070c6-0b06-4465-90c4-03a208f00e41 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:24 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-ccd070c6-0b06-4465-90c4-03a208f00e41 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:35:25 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-ccd070c6-0b06-4465-90c4-03a208f00e41 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:35:25 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-ccd070c6-0b06-4465-90c4-03a208f00e41 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:35:25 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-ccd070c6-0b06-4465-90c4-03a208f00e41 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:35:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-ccd070c6-0b06-4465-90c4-03a208f00e41 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f55cab4-8530-4be0-a91d-65671f0dccd9" status: 200 len: 1394 microversion: 2.87 time: 0.241061 Apr 12 10:35:25 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 25/79] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:35:24 2023] GET /compute/v2.1/servers/0f55cab4-8530-4be0-a91d-65671f0dccd9 => generated 1394 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:35:25 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1850921758", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "networks": [{"uuid": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de"}], "security_groups": [{"name": "tempest-securitygroup--416739598"}], "key_name": "tempest-keypair-1741756118", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:26 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] validate_networks() for [('4d3f7dc3-82bc-43ab-be83-29e8f16f99de', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:35:27 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:35:27 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:35:27 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:35:27 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:35:27 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:35:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:27 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Getting quotas for project 8ce2a3bde13e464f8df0a41f30c240ab. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:35:27 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Getting quotas for user c757f04065b9488ba75739e59d7be377 and project 8ce2a3bde13e464f8df0a41f30c240ab. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:35:27 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:35:27 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:35:27 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.902471 Apr 12 10:35:27 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 29/80] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:35:25 2023] POST /compute/v2.1/servers => generated 403 bytes in 1905 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:35:27 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-dcb10cf7-dad2-492c-8a36-0b6fb678936d tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:27 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-dcb10cf7-dad2-492c-8a36-0b6fb678936d tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:35:27 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-dcb10cf7-dad2-492c-8a36-0b6fb678936d tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c757f04065b9488ba75739e59d7be377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce2a3bde13e464f8df0a41f30c240ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:35:27 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-dcb10cf7-dad2-492c-8a36-0b6fb678936d tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5" status: 200 len: 1240 microversion: 2.1 time: 0.089868 Apr 12 10:35:27 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 26/81] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:35:27 2023] GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:35:28 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:35:28 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:35:28 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:35:28 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:35:28 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:35:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:28 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting quotas for project 32235c67d269474b879a58269c1bfb28. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:35:28 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting quotas for user 0059d31539304ffcb5214b408751cd4f and project 32235c67d269474b879a58269c1bfb28. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:35:28 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:35:28 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:35:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 5.172418 Apr 12 10:35:29 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 27/82] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:35:23 2023] POST /compute/v2.1/servers => generated 407 bytes in 5175 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:35:29 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-93913907-90ac-4c7f-8e13-163127af6761 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:29 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-93913907-90ac-4c7f-8e13-163127af6761 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:35:29 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-93913907-90ac-4c7f-8e13-163127af6761 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:35:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-93913907-90ac-4c7f-8e13-163127af6761 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1233 microversion: 2.1 time: 0.253382 Apr 12 10:35:29 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 30/83] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:35:29 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1233 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:35:30 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-620034952", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "networks": [{"uuid": "092e35b9-633d-403b-a777-df3e8c018327"}]}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:30 user devstack@n-api.service[61852]: DEBUG nova.network.neutron [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] validate_networks() for [('092e35b9-633d-403b-a777-df3e8c018327', None, None, None, None, None)] {{(pid=61852) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:35:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-45580f68-6091-4380-94ca-46114181b02e req-9a0f2109-b145-4f86-8fd9-8929fc66631c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270d5d4d-4df6-4ba5-9145-98f343fb3b0e", "name": "network-vif-plugged", "status": "completed", "tag": "42768d69-c7da-43fb-b092-c5b41ac2d55c"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-45580f68-6091-4380-94ca-46114181b02e req-9a0f2109-b145-4f86-8fd9-8929fc66631c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-45580f68-6091-4380-94ca-46114181b02e req-9a0f2109-b145-4f86-8fd9-8929fc66631c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-45580f68-6091-4380-94ca-46114181b02e req-9a0f2109-b145-4f86-8fd9-8929fc66631c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-45580f68-6091-4380-94ca-46114181b02e req-9a0f2109-b145-4f86-8fd9-8929fc66631c service nova] Creating event network-vif-plugged:42768d69-c7da-43fb-b092-c5b41ac2d55c for instance 270d5d4d-4df6-4ba5-9145-98f343fb3b0e on user Apr 12 10:35:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-45580f68-6091-4380-94ca-46114181b02e req-9a0f2109-b145-4f86-8fd9-8929fc66631c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61854) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 10:35:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-45580f68-6091-4380-94ca-46114181b02e req-9a0f2109-b145-4f86-8fd9-8929fc66631c service nova] Acquired lock "compute-rpcapi-router" {{(pid=61854) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 10:35:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0ecb4962-51e4-4e0b-bf5c-f91e5c8c8e4d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0ecb4962-51e4-4e0b-bf5c-f91e5c8c8e4d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0ecb4962-51e4-4e0b-bf5c-f91e5c8c8e4d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0ecb4962-51e4-4e0b-bf5c-f91e5c8c8e4d None None] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0ecb4962-51e4-4e0b-bf5c-f91e5c8c8e4d None None] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0ecb4962-51e4-4e0b-bf5c-f91e5c8c8e4d None None] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:31 user devstack@n-api.service[61854]: INFO nova.compute.rpcapi [None req-0ecb4962-51e4-4e0b-bf5c-f91e5c8c8e4d None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 10:35:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0ecb4962-51e4-4e0b-bf5c-f91e5c8c8e4d None None] Releasing lock "compute-rpcapi-router" {{(pid=61854) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 10:35:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-0ecb4962-51e4-4e0b-bf5c-f91e5c8c8e4d None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206884 Apr 12 10:35:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 28/84] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:35:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:32 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-8b0c428b-ef2e-46a2-b9dd-680875e3549a req-a9adb239-4e09-481d-8b5a-1901c272c8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f55cab4-8530-4be0-a91d-65671f0dccd9", "tag": "e1506948-cd44-4d78-a019-853199016229"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:32 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Flavor limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:35:32 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Image limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:35:32 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Flavor pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:35:32 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Image pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:35:32 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:35:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8b0c428b-ef2e-46a2-b9dd-680875e3549a req-a9adb239-4e09-481d-8b5a-1901c272c8b6 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:32 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1259808068", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "networks": [{"uuid": "46ccc4d2-269b-4c92-bee1-2846e0d47bd3"}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8b0c428b-ef2e-46a2-b9dd-680875e3549a req-a9adb239-4e09-481d-8b5a-1901c272c8b6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8b0c428b-ef2e-46a2-b9dd-680875e3549a req-a9adb239-4e09-481d-8b5a-1901c272c8b6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:32 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Getting quotas for project 024682bfda5548b8b9b404c85dd55b34. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:35:32 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-8b0c428b-ef2e-46a2-b9dd-680875e3549a req-a9adb239-4e09-481d-8b5a-1901c272c8b6 service nova] Creating event network-changed:e1506948-cd44-4d78-a019-853199016229 for instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 on user Apr 12 10:35:32 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Getting quotas for user 33d19bfc4894401cb664521438338b9a and project 024682bfda5548b8b9b404c85dd55b34. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:35:32 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-8b0c428b-ef2e-46a2-b9dd-680875e3549a req-a9adb239-4e09-481d-8b5a-1901c272c8b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067812 Apr 12 10:35:32 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 29/85] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:35:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:32 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Going to run 1 instances... {{(pid=61852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:35:32 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:35:32 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] validate_networks() for [('46ccc4d2-269b-4c92-bee1-2846e0d47bd3', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:35:32 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.422260 Apr 12 10:35:32 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 27/86] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:35:30 2023] POST /compute/v2.1/servers => generated 378 bytes in 2424 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:35:32 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-cbd39a15-f63d-4048-a35c-7df0fa756fc9 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:32 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-cbd39a15-f63d-4048-a35c-7df0fa756fc9 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:35:32 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-cbd39a15-f63d-4048-a35c-7df0fa756fc9 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d19bfc4894401cb664521438338b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024682bfda5548b8b9b404c85dd55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:35:32 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-cbd39a15-f63d-4048-a35c-7df0fa756fc9 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586" status: 200 len: 1210 microversion: 2.1 time: 0.129975 Apr 12 10:35:32 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 30/87] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:35:32 2023] GET /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586 => generated 1210 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:35:34 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-bd7750f6-06b0-4e8e-9fef-959bd4d38354 req-3616d486-2f24-499f-b503-22ecc4b294db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270d5d4d-4df6-4ba5-9145-98f343fb3b0e", "name": "network-vif-plugged", "status": "completed", "tag": "42768d69-c7da-43fb-b092-c5b41ac2d55c"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-bd7750f6-06b0-4e8e-9fef-959bd4d38354 req-3616d486-2f24-499f-b503-22ecc4b294db service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-bd7750f6-06b0-4e8e-9fef-959bd4d38354 req-3616d486-2f24-499f-b503-22ecc4b294db service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-bd7750f6-06b0-4e8e-9fef-959bd4d38354 req-3616d486-2f24-499f-b503-22ecc4b294db service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:34 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-bd7750f6-06b0-4e8e-9fef-959bd4d38354 req-3616d486-2f24-499f-b503-22ecc4b294db service nova] Creating event network-vif-plugged:42768d69-c7da-43fb-b092-c5b41ac2d55c for instance 270d5d4d-4df6-4ba5-9145-98f343fb3b0e on user Apr 12 10:35:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-bd7750f6-06b0-4e8e-9fef-959bd4d38354 req-3616d486-2f24-499f-b503-22ecc4b294db service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61852) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 10:35:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-bd7750f6-06b0-4e8e-9fef-959bd4d38354 req-3616d486-2f24-499f-b503-22ecc4b294db service nova] Acquired lock "compute-rpcapi-router" {{(pid=61852) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 10:35:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a3c69dbd-4e1c-4054-a56e-3413d7e445b9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a3c69dbd-4e1c-4054-a56e-3413d7e445b9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a3c69dbd-4e1c-4054-a56e-3413d7e445b9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a3c69dbd-4e1c-4054-a56e-3413d7e445b9 None None] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a3c69dbd-4e1c-4054-a56e-3413d7e445b9 None None] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a3c69dbd-4e1c-4054-a56e-3413d7e445b9 None None] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:34 user devstack@n-api.service[61852]: INFO nova.compute.rpcapi [None req-a3c69dbd-4e1c-4054-a56e-3413d7e445b9 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 10:35:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a3c69dbd-4e1c-4054-a56e-3413d7e445b9 None None] Releasing lock "compute-rpcapi-router" {{(pid=61852) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 10:35:34 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-a3c69dbd-4e1c-4054-a56e-3413d7e445b9 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112836 Apr 12 10:35:34 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 28/88] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:35:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:34 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:35:34 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:35:34 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:35:34 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:35:34 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:35:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:34 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Getting quotas for project d3dbf247dab94f6eb32e7808314d420a. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:35:34 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Getting quotas for user 3766c8ddd6ae4fdd9d4aa6929cc080cf and project d3dbf247dab94f6eb32e7808314d420a. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:35:34 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:35:34 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:35:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.313142 Apr 12 10:35:34 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 31/89] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:35:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 2315 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:35:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ffc73c17-02bc-4eba-9107-f02cfef5961c tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:34 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-ffc73c17-02bc-4eba-9107-f02cfef5961c tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:35:35 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-ffc73c17-02bc-4eba-9107-f02cfef5961c tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3766c8ddd6ae4fdd9d4aa6929cc080cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dbf247dab94f6eb32e7808314d420a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:35:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ffc73c17-02bc-4eba-9107-f02cfef5961c tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3" status: 200 len: 1209 microversion: 2.1 time: 0.444600 Apr 12 10:35:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 31/90] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:35:34 2023] GET /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3 => generated 1209 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:35:36 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-67a8f498-0359-425d-8111-8e003089eff1 req-ad7b09f3-21ae-4fbf-8468-fb06b8b3242a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47d368e-3870-49d0-8522-a94991ec4ba5", "tag": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-67a8f498-0359-425d-8111-8e003089eff1 req-ad7b09f3-21ae-4fbf-8468-fb06b8b3242a service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-67a8f498-0359-425d-8111-8e003089eff1 req-ad7b09f3-21ae-4fbf-8468-fb06b8b3242a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-67a8f498-0359-425d-8111-8e003089eff1 req-ad7b09f3-21ae-4fbf-8468-fb06b8b3242a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:36 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-67a8f498-0359-425d-8111-8e003089eff1 req-ad7b09f3-21ae-4fbf-8468-fb06b8b3242a service nova] Creating event network-changed:7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance f47d368e-3870-49d0-8522-a94991ec4ba5 on user Apr 12 10:35:36 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-67a8f498-0359-425d-8111-8e003089eff1 req-ad7b09f3-21ae-4fbf-8468-fb06b8b3242a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120805 Apr 12 10:35:36 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 29/91] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:35:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:36 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-3b738a4f-54db-45a8-bba8-e396e739643c req-a63f6363-803e-4c32-8e9b-fe88abe91c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f55cab4-8530-4be0-a91d-65671f0dccd9", "name": "network-vif-plugged", "status": "completed", "tag": "e1506948-cd44-4d78-a019-853199016229"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3b738a4f-54db-45a8-bba8-e396e739643c req-a63f6363-803e-4c32-8e9b-fe88abe91c22 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3b738a4f-54db-45a8-bba8-e396e739643c req-a63f6363-803e-4c32-8e9b-fe88abe91c22 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3b738a4f-54db-45a8-bba8-e396e739643c req-a63f6363-803e-4c32-8e9b-fe88abe91c22 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-3b738a4f-54db-45a8-bba8-e396e739643c req-a63f6363-803e-4c32-8e9b-fe88abe91c22 service nova] Creating event network-vif-plugged:e1506948-cd44-4d78-a019-853199016229 for instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 on user Apr 12 10:35:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-3b738a4f-54db-45a8-bba8-e396e739643c req-a63f6363-803e-4c32-8e9b-fe88abe91c22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047589 Apr 12 10:35:36 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 32/92] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:35:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-73983e20-7e6c-432c-9501-8410d8b72b34 req-1f6058f1-62d7-434e-8044-7830039c963c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-73983e20-7e6c-432c-9501-8410d8b72b34 req-1f6058f1-62d7-434e-8044-7830039c963c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-73983e20-7e6c-432c-9501-8410d8b72b34 req-1f6058f1-62d7-434e-8044-7830039c963c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-73983e20-7e6c-432c-9501-8410d8b72b34 req-1f6058f1-62d7-434e-8044-7830039c963c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-73983e20-7e6c-432c-9501-8410d8b72b34 req-1f6058f1-62d7-434e-8044-7830039c963c service nova] Creating event network-changed:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:35:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-73983e20-7e6c-432c-9501-8410d8b72b34 req-1f6058f1-62d7-434e-8044-7830039c963c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051661 Apr 12 10:35:38 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 32/93] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:35:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:38 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-b6edd93a-0dbf-482f-b818-a4c41ebb4b41 req-539a17b5-84a9-4c10-bff5-574dfaaaf9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f55cab4-8530-4be0-a91d-65671f0dccd9", "name": "network-vif-plugged", "status": "completed", "tag": "e1506948-cd44-4d78-a019-853199016229"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-b6edd93a-0dbf-482f-b818-a4c41ebb4b41 req-539a17b5-84a9-4c10-bff5-574dfaaaf9d6 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-b6edd93a-0dbf-482f-b818-a4c41ebb4b41 req-539a17b5-84a9-4c10-bff5-574dfaaaf9d6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-b6edd93a-0dbf-482f-b818-a4c41ebb4b41 req-539a17b5-84a9-4c10-bff5-574dfaaaf9d6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:38 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-b6edd93a-0dbf-482f-b818-a4c41ebb4b41 req-539a17b5-84a9-4c10-bff5-574dfaaaf9d6 service nova] Creating event network-vif-plugged:e1506948-cd44-4d78-a019-853199016229 for instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 on user Apr 12 10:35:38 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-b6edd93a-0dbf-482f-b818-a4c41ebb4b41 req-539a17b5-84a9-4c10-bff5-574dfaaaf9d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036878 Apr 12 10:35:38 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 30/94] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:35:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:35:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-4d4c775c-cc23-4483-b03c-3b5009ab36b1 req-cea3566a-433a-4711-9158-e90ec05fd4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47d368e-3870-49d0-8522-a94991ec4ba5", "name": "network-vif-plugged", "status": "completed", "tag": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-4d4c775c-cc23-4483-b03c-3b5009ab36b1 req-cea3566a-433a-4711-9158-e90ec05fd4e2 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-4d4c775c-cc23-4483-b03c-3b5009ab36b1 req-cea3566a-433a-4711-9158-e90ec05fd4e2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-4d4c775c-cc23-4483-b03c-3b5009ab36b1 req-cea3566a-433a-4711-9158-e90ec05fd4e2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-4d4c775c-cc23-4483-b03c-3b5009ab36b1 req-cea3566a-433a-4711-9158-e90ec05fd4e2 service nova] Creating event network-vif-plugged:7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance f47d368e-3870-49d0-8522-a94991ec4ba5 on user Apr 12 10:35:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-4d4c775c-cc23-4483-b03c-3b5009ab36b1 req-cea3566a-433a-4711-9158-e90ec05fd4e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034034 Apr 12 10:35:39 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 33/95] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:35:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc6eb5d4-d415-4459-a95b-5a470ec66586", "tag": "54a35da3-7130-4116-a695-1d7da8f0afc8"}, {"server_uuid": "f47d368e-3870-49d0-8522-a94991ec4ba5", "name": "network-vif-plugged", "status": "completed", "tag": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] Creating event network-changed:54a35da3-7130-4116-a695-1d7da8f0afc8 for instance dc6eb5d4-d415-4459-a95b-5a470ec66586 on user Apr 12 10:35:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] Creating event network-vif-plugged:7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance f47d368e-3870-49d0-8522-a94991ec4ba5 on user Apr 12 10:35:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.097355 Apr 12 10:35:41 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 33/96] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:35:41 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:43 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=14 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:43 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-a991313a-6416-4f65-ace7-89408c08db3b req-e9fa2483-d88b-4497-a287-f7a3f85c14e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d49077-b100-4630-b4f8-00c3daffb9e3", "tag": "74fb6084-85b5-4bc1-9933-5886e90483fd"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:43 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-a991313a-6416-4f65-ace7-89408c08db3b req-e9fa2483-d88b-4497-a287-f7a3f85c14e6 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:43 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-a991313a-6416-4f65-ace7-89408c08db3b req-e9fa2483-d88b-4497-a287-f7a3f85c14e6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:43 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-a991313a-6416-4f65-ace7-89408c08db3b req-e9fa2483-d88b-4497-a287-f7a3f85c14e6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:43 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-a991313a-6416-4f65-ace7-89408c08db3b req-e9fa2483-d88b-4497-a287-f7a3f85c14e6 service nova] Creating event network-changed:74fb6084-85b5-4bc1-9933-5886e90483fd for instance c4d49077-b100-4630-b4f8-00c3daffb9e3 on user Apr 12 10:35:43 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-a991313a-6416-4f65-ace7-89408c08db3b req-e9fa2483-d88b-4497-a287-f7a3f85c14e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041730 Apr 12 10:35:43 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 31/97] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:35:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-adad66c0-8d87-4854-9ae2-7a817f4fbc47 req-cc03ba97-1e50-4c84-aef1-fbcd0bcc3c5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-plugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-adad66c0-8d87-4854-9ae2-7a817f4fbc47 req-cc03ba97-1e50-4c84-aef1-fbcd0bcc3c5c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-adad66c0-8d87-4854-9ae2-7a817f4fbc47 req-cc03ba97-1e50-4c84-aef1-fbcd0bcc3c5c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-adad66c0-8d87-4854-9ae2-7a817f4fbc47 req-cc03ba97-1e50-4c84-aef1-fbcd0bcc3c5c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-adad66c0-8d87-4854-9ae2-7a817f4fbc47 req-cc03ba97-1e50-4c84-aef1-fbcd0bcc3c5c service nova] Creating event network-vif-plugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:35:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-adad66c0-8d87-4854-9ae2-7a817f4fbc47 req-cc03ba97-1e50-4c84-aef1-fbcd0bcc3c5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041983 Apr 12 10:35:43 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 34/98] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:35:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:45 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:45 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=14 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:45 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-5900b30f-c26a-4e2c-85b3-27a6c4addca0 req-74219c4f-b98d-499e-958e-6cfa283ccd2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6eb5d4-d415-4459-a95b-5a470ec66586", "name": "network-vif-plugged", "status": "completed", "tag": "54a35da3-7130-4116-a695-1d7da8f0afc8"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5900b30f-c26a-4e2c-85b3-27a6c4addca0 req-74219c4f-b98d-499e-958e-6cfa283ccd2d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5900b30f-c26a-4e2c-85b3-27a6c4addca0 req-74219c4f-b98d-499e-958e-6cfa283ccd2d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5900b30f-c26a-4e2c-85b3-27a6c4addca0 req-74219c4f-b98d-499e-958e-6cfa283ccd2d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-5900b30f-c26a-4e2c-85b3-27a6c4addca0 req-74219c4f-b98d-499e-958e-6cfa283ccd2d service nova] Creating event network-vif-plugged:54a35da3-7130-4116-a695-1d7da8f0afc8 for instance dc6eb5d4-d415-4459-a95b-5a470ec66586 on user Apr 12 10:35:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-5900b30f-c26a-4e2c-85b3-27a6c4addca0 req-74219c4f-b98d-499e-958e-6cfa283ccd2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078649 Apr 12 10:35:45 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 34/99] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:35:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:46 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:46 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-11d33eea-7296-4dc4-9c57-abdc2e5c59e5 req-9f02a93e-c744-42cf-85df-f9625cd9c5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-plugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-11d33eea-7296-4dc4-9c57-abdc2e5c59e5 req-9f02a93e-c744-42cf-85df-f9625cd9c5f0 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-11d33eea-7296-4dc4-9c57-abdc2e5c59e5 req-9f02a93e-c744-42cf-85df-f9625cd9c5f0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-11d33eea-7296-4dc4-9c57-abdc2e5c59e5 req-9f02a93e-c744-42cf-85df-f9625cd9c5f0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-11d33eea-7296-4dc4-9c57-abdc2e5c59e5 req-9f02a93e-c744-42cf-85df-f9625cd9c5f0 service nova] Creating event network-vif-plugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:35:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-11d33eea-7296-4dc4-9c57-abdc2e5c59e5 req-9f02a93e-c744-42cf-85df-f9625cd9c5f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040583 Apr 12 10:35:46 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 32/100] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:35:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:46 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=8 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:46 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=20 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-9066fb9a-8181-461e-93f0-57a41e42b0d4 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Action: 'create', calling method: .version_select at 0x7fabc05ea4d0>, body: {"keypair": {"name": "tempest-keypair-1653078636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMgsXxSbNHsheROx1BN0FtpB7qh5cv6vGRZHqITyCcIMFeCSyHdp/zIeAbEJot43g3Qpc0b2rVShkKAnaPuRxIo8TB/FzjRPcSXAtyG2n+PHfMt7nLlc2G1KtiPlyKvOQ=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:47 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-9066fb9a-8181-461e-93f0-57a41e42b0d4 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Getting quotas for project 0cdb8217b1544db384bebe1059848bb6. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:35:47 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-9066fb9a-8181-461e-93f0-57a41e42b0d4 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Getting quotas for user a0a2243c6c9f431da846cc54ec181fcc and project 0cdb8217b1544db384bebe1059848bb6. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:35:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-9066fb9a-8181-461e-93f0-57a41e42b0d4 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.554091 Apr 12 10:35:47 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 35/101] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 10:35:46 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:47 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-f4766914-4d9e-43ab-97b5-61cd76dbd83e req-91a2866d-5912-47e5-b6ff-e1e0203ee8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6eb5d4-d415-4459-a95b-5a470ec66586", "name": "network-vif-plugged", "status": "completed", "tag": "54a35da3-7130-4116-a695-1d7da8f0afc8"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f4766914-4d9e-43ab-97b5-61cd76dbd83e req-91a2866d-5912-47e5-b6ff-e1e0203ee8af service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f4766914-4d9e-43ab-97b5-61cd76dbd83e req-91a2866d-5912-47e5-b6ff-e1e0203ee8af service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f4766914-4d9e-43ab-97b5-61cd76dbd83e req-91a2866d-5912-47e5-b6ff-e1e0203ee8af service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:47 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f4766914-4d9e-43ab-97b5-61cd76dbd83e req-91a2866d-5912-47e5-b6ff-e1e0203ee8af service nova] Creating event network-vif-plugged:54a35da3-7130-4116-a695-1d7da8f0afc8 for instance dc6eb5d4-d415-4459-a95b-5a470ec66586 on user Apr 12 10:35:47 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-f4766914-4d9e-43ab-97b5-61cd76dbd83e req-91a2866d-5912-47e5-b6ff-e1e0203ee8af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083053 Apr 12 10:35:47 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 35/102] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:35:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:48 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d49077-b100-4630-b4f8-00c3daffb9e3", "name": "network-vif-plugged", "status": "completed", "tag": "74fb6084-85b5-4bc1-9933-5886e90483fd"}, {"server_uuid": "c4d49077-b100-4630-b4f8-00c3daffb9e3", "name": "network-vif-plugged", "status": "completed", "tag": "74fb6084-85b5-4bc1-9933-5886e90483fd"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:48 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:48 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:48 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:48 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] Creating event network-vif-plugged:74fb6084-85b5-4bc1-9933-5886e90483fd for instance c4d49077-b100-4630-b4f8-00c3daffb9e3 on user Apr 12 10:35:48 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] Creating event network-vif-plugged:74fb6084-85b5-4bc1-9933-5886e90483fd for instance c4d49077-b100-4630-b4f8-00c3daffb9e3 on user Apr 12 10:35:48 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086339 Apr 12 10:35:48 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 33/103] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:35:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:49 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0fa4cf54-2420-4151-af5b-10cdd6ff991a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Action: 'create', calling method: .version_select at 0x7fabc05ea560>, body: {"keypair": {"name": "tempest-keypair-1030522827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjYthrvQaeO5iRkpOme8wd9BXslJ7+bH9c2pwqGtw4ONI6Nky7fjGEhK/7wi0cE/C4qW3/+u5Kcz2ZNhnlwfyEfLgpJZMopCh6eIMANDCmV2ciSVUgehPex6h7+lEIbHQ=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:49 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=10 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:49 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-0fa4cf54-2420-4151-af5b-10cdd6ff991a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Getting quotas for project 91b7b715cc24490ebd04d5469b6e07ce. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:35:49 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-0fa4cf54-2420-4151-af5b-10cdd6ff991a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Getting quotas for user 80dbdeaccf84466286a6d85921e15a3f and project 91b7b715cc24490ebd04d5469b6e07ce. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:35:49 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-0fa4cf54-2420-4151-af5b-10cdd6ff991a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102165 Apr 12 10:35:49 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 36/104] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 10:35:49 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:51 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1739620818", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "networks": [{"uuid": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0"}], "security_groups": [{"name": "tempest-securitygroup--1800756990"}], "key_name": "tempest-keypair-1653078636", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:51 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:52 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] validate_networks() for [('66f6d7b6-8980-47a3-a7b6-f62db8264cd0', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:35:52 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:35:52 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:35:52 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:35:52 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:35:52 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:35:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:52 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:52 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1772353252", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "networks": [{"uuid": "d823a4e6-ea4f-426a-8afe-49a806172180"}], "security_groups": [{"name": "tempest-securitygroup--1190980918"}], "key_name": "tempest-keypair-1030522827", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:52 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Getting quotas for project 0cdb8217b1544db384bebe1059848bb6. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:35:52 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Getting quotas for user a0a2243c6c9f431da846cc54ec181fcc and project 0cdb8217b1544db384bebe1059848bb6. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:35:52 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:52 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:35:52 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:35:52 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.976137 Apr 12 10:35:52 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 36/105] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:35:51 2023] POST /compute/v2.1/servers => generated 404 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:35:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-cf66f1e4-f989-49fc-aae2-dec725cd1599 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:52 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-cf66f1e4-f989-49fc-aae2-dec725cd1599 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:35:52 user devstack@n-api.service[61852]: DEBUG nova.network.neutron [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] validate_networks() for [('d823a4e6-ea4f-426a-8afe-49a806172180', None, None, None, None, None)] {{(pid=61852) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:35:52 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-cf66f1e4-f989-49fc-aae2-dec725cd1599 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a2243c6c9f431da846cc54ec181fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb8217b1544db384bebe1059848bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:35:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-cf66f1e4-f989-49fc-aae2-dec725cd1599 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30" status: 200 len: 1236 microversion: 2.1 time: 0.076015 Apr 12 10:35:52 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 37/106] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:35:52 2023] GET /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30 => generated 1236 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:35:53 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Flavor limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:35:53 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Image limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:35:53 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Flavor pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:35:53 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Image pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:35:53 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:35:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:53 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Getting quotas for project 91b7b715cc24490ebd04d5469b6e07ce. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:35:53 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Getting quotas for user 80dbdeaccf84466286a6d85921e15a3f and project 91b7b715cc24490ebd04d5469b6e07ce. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:35:53 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Going to run 1 instances... {{(pid=61852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:35:53 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-413d752b-f13d-4dac-a870-1b94f28e3064 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Action: 'create', calling method: .version_select at 0x7fabc05def80>, body: {"keypair": {"name": "tempest-keypair-1229893823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzQawsEeqCly4GrkNJAA9BBwNnMJnPgKodH8mU0eVkzeBhsPPS+9XOw4Ves3ommAtM8yIxnCyFKIdDYuEUOj5JIixEV4XVMiYn1a4c9klmAXFo78LZXAV5NnNG2cYaSuw=="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:53 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:35:53 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-413d752b-f13d-4dac-a870-1b94f28e3064 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Getting quotas for project cede3351295e451283a0414aefea1de5. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:35:53 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-413d752b-f13d-4dac-a870-1b94f28e3064 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Getting quotas for user b2f1517aae734c8aa5b0acbc906af9c0 and project cede3351295e451283a0414aefea1de5. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:35:53 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-413d752b-f13d-4dac-a870-1b94f28e3064 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.209330 Apr 12 10:35:53 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 37/107] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 10:35:53 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:53 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.202694 Apr 12 10:35:53 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 34/108] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:35:52 2023] POST /compute/v2.1/servers => generated 404 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 12 10:35:53 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0a53fbcd-73c2-4ac9-b214-ccfed0c94b3a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:53 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-0a53fbcd-73c2-4ac9-b214-ccfed0c94b3a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:35:53 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=16 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:53 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-0a53fbcd-73c2-4ac9-b214-ccfed0c94b3a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80dbdeaccf84466286a6d85921e15a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b7b715cc24490ebd04d5469b6e07ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:35:54 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-0a53fbcd-73c2-4ac9-b214-ccfed0c94b3a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb" status: 200 len: 1226 microversion: 2.1 time: 0.271073 Apr 12 10:35:54 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 38/109] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:35:53 2023] GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb => generated 1226 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:35:55 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-328020930", "imageRef": "635d50f2-49f4-4589-b08b-3bd3f2f32a2e", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "38b15083-7fc7-4136-940b-ac6f8ce892a7"}], "security_groups": [{"name": "tempest-securitygroup--1356763636"}], "key_name": "tempest-keypair-1229893823", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:56 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] validate_networks() for [('38b15083-7fc7-4136-940b-ac6f8ce892a7', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:35:56 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:35:56 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:35:56 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:35:56 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:35:56 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:35:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:56 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=19 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:35:56 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Getting quotas for project cede3351295e451283a0414aefea1de5. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:35:56 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Getting quotas for user b2f1517aae734c8aa5b0acbc906af9c0 and project cede3351295e451283a0414aefea1de5. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:35:56 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:35:56 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='635d50f2-49f4-4589-b08b-3bd3f2f32a2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:35:56 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.007164 Apr 12 10:35:56 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 38/110] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:35:55 2023] POST /compute/v2.1/servers => generated 404 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:35:56 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-4715032d-e332-421e-bcee-b730a3b5be6f tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:56 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-4715032d-e332-421e-bcee-b730a3b5be6f tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:35:56 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-4715032d-e332-421e-bcee-b730a3b5be6f tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f1517aae734c8aa5b0acbc906af9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cede3351295e451283a0414aefea1de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:35:56 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-4715032d-e332-421e-bcee-b730a3b5be6f tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e" status: 200 len: 1239 microversion: 2.1 time: 0.090544 Apr 12 10:35:56 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 35/111] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:35:56 2023] GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e => generated 1239 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:35:57 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-bc6c53c8-b38c-4356-a2b3-d8484e1976fe req-2c9b3f88-aeeb-45ab-ba9e-479cf07f4c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d04cb526-f77a-457c-90b1-3e5c202c0c30", "tag": "d6cd169f-f736-45da-96ea-c0b933c882a0"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-bc6c53c8-b38c-4356-a2b3-d8484e1976fe req-2c9b3f88-aeeb-45ab-ba9e-479cf07f4c5e service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-bc6c53c8-b38c-4356-a2b3-d8484e1976fe req-2c9b3f88-aeeb-45ab-ba9e-479cf07f4c5e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-bc6c53c8-b38c-4356-a2b3-d8484e1976fe req-2c9b3f88-aeeb-45ab-ba9e-479cf07f4c5e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:57 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-bc6c53c8-b38c-4356-a2b3-d8484e1976fe req-2c9b3f88-aeeb-45ab-ba9e-479cf07f4c5e service nova] Creating event network-changed:d6cd169f-f736-45da-96ea-c0b933c882a0 for instance d04cb526-f77a-457c-90b1-3e5c202c0c30 on user Apr 12 10:35:57 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-bc6c53c8-b38c-4356-a2b3-d8484e1976fe req-2c9b3f88-aeeb-45ab-ba9e-479cf07f4c5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043011 Apr 12 10:35:57 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 39/112] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:35:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:57 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-c4d65105-56e2-404e-81af-247198553065 req-828a4024-2386-47f1-9cef-4dfda7de9c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea55f551-968e-4ece-a37a-c4128ce5e8cb", "tag": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c4d65105-56e2-404e-81af-247198553065 req-828a4024-2386-47f1-9cef-4dfda7de9c68 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c4d65105-56e2-404e-81af-247198553065 req-828a4024-2386-47f1-9cef-4dfda7de9c68 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c4d65105-56e2-404e-81af-247198553065 req-828a4024-2386-47f1-9cef-4dfda7de9c68 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-c4d65105-56e2-404e-81af-247198553065 req-828a4024-2386-47f1-9cef-4dfda7de9c68 service nova] Creating event network-changed:9d4bc0b7-4a2b-4354-a609-c673f6235cc7 for instance ea55f551-968e-4ece-a37a-c4128ce5e8cb on user Apr 12 10:35:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-c4d65105-56e2-404e-81af-247198553065 req-828a4024-2386-47f1-9cef-4dfda7de9c68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044334 Apr 12 10:35:57 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 39/113] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:35:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:35:57 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-6130e25c-1d7a-46d1-b850-8e0688d90c61 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Action: 'create', calling method: .version_select at 0x7fabc058b5b0>, body: {"keypair": {"name": "tempest-keypair-1041772862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdimvfCdLuB4VkmLV8sKAN/mnwsyMwY8NOOti+AyTKIr7DOlGneUneWZujzSPReHJ3Bkx1IiksPqGfbsqao0C74w5qd657VSCv5dx2mJ7By8lLfjmYEB3fpEh2Gj0rqkQ=="}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:35:57 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-6130e25c-1d7a-46d1-b850-8e0688d90c61 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Getting quotas for project 6981486a29b64ee7b9ef7cbf2ca852be. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:35:57 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-6130e25c-1d7a-46d1-b850-8e0688d90c61 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Getting quotas for user 254d3560065c4d8a8aaf312870be2967 and project 6981486a29b64ee7b9ef7cbf2ca852be. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:35:57 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-6130e25c-1d7a-46d1-b850-8e0688d90c61 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.057607 Apr 12 10:35:57 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 36/114] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 10:35:57 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 10:35:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-191d5aaf-b4e6-4c55-a382-1cb3645ce7e4 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:35:59 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-191d5aaf-b4e6-4c55-a382-1cb3645ce7e4 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:35:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-191d5aaf-b4e6-4c55-a382-1cb3645ce7e4 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-191d5aaf-b4e6-4c55-a382-1cb3645ce7e4 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-191d5aaf-b4e6-4c55-a382-1cb3645ce7e4 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-191d5aaf-b4e6-4c55-a382-1cb3645ce7e4 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:35:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-191d5aaf-b4e6-4c55-a382-1cb3645ce7e4 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:35:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-191d5aaf-b4e6-4c55-a382-1cb3645ce7e4 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:35:59 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-191d5aaf-b4e6-4c55-a382-1cb3645ce7e4 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064f86e997904027aa9f086e3b137916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8cbfbed2c843f796e810c6cc8530ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:35:59 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-191d5aaf-b4e6-4c55-a382-1cb3645ce7e4 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] 10.0.0.210 "GET /compute/v2.1/servers/270d5d4d-4df6-4ba5-9145-98f343fb3b0e" status: 200 len: 1454 microversion: 2.1 time: 0.347379 Apr 12 10:35:59 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 40/115] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:35:59 2023] GET /compute/v2.1/servers/270d5d4d-4df6-4ba5-9145-98f343fb3b0e => generated 1454 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:36:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-973136543", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "4f4a6f13-7642-4157-ba75-be13336c456e"}], "security_groups": [{"name": "tempest-securitygroup--1264308035"}], "key_name": "tempest-keypair-1041772862", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:00 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-e6056bf8-0bba-4178-b9d1-97c3a021299f req-c70ed30d-22db-4b57-b25d-a3203e72141c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d04cb526-f77a-457c-90b1-3e5c202c0c30", "name": "network-vif-plugged", "status": "completed", "tag": "d6cd169f-f736-45da-96ea-c0b933c882a0"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:00 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] validate_networks() for [('4f4a6f13-7642-4157-ba75-be13336c456e', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:36:00 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e6056bf8-0bba-4178-b9d1-97c3a021299f req-c70ed30d-22db-4b57-b25d-a3203e72141c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:00 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e6056bf8-0bba-4178-b9d1-97c3a021299f req-c70ed30d-22db-4b57-b25d-a3203e72141c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:00 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e6056bf8-0bba-4178-b9d1-97c3a021299f req-c70ed30d-22db-4b57-b25d-a3203e72141c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:00 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-e6056bf8-0bba-4178-b9d1-97c3a021299f req-c70ed30d-22db-4b57-b25d-a3203e72141c service nova] Creating event network-vif-plugged:d6cd169f-f736-45da-96ea-c0b933c882a0 for instance d04cb526-f77a-457c-90b1-3e5c202c0c30 on user Apr 12 10:36:00 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-e6056bf8-0bba-4178-b9d1-97c3a021299f req-c70ed30d-22db-4b57-b25d-a3203e72141c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039444 Apr 12 10:36:00 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 37/116] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:36:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:36:00 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-d90b2069-2c02-4671-9700-3ced10fb21a0 req-8232c9fc-91f2-4677-b240-13f5b075060c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d261c30-0c6f-4d1b-8965-448dc019728e", "tag": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d90b2069-2c02-4671-9700-3ced10fb21a0 req-8232c9fc-91f2-4677-b240-13f5b075060c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d90b2069-2c02-4671-9700-3ced10fb21a0 req-8232c9fc-91f2-4677-b240-13f5b075060c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d90b2069-2c02-4671-9700-3ced10fb21a0 req-8232c9fc-91f2-4677-b240-13f5b075060c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:00 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-d90b2069-2c02-4671-9700-3ced10fb21a0 req-8232c9fc-91f2-4677-b240-13f5b075060c service nova] Creating event network-changed:166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 for instance 3d261c30-0c6f-4d1b-8965-448dc019728e on user Apr 12 10:36:00 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-d90b2069-2c02-4671-9700-3ced10fb21a0 req-8232c9fc-91f2-4677-b240-13f5b075060c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048086 Apr 12 10:36:00 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 41/117] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:36:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:36:01 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:36:01 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:36:01 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:36:01 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:36:01 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:36:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:01 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Getting quotas for project 6981486a29b64ee7b9ef7cbf2ca852be. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:36:01 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Getting quotas for user 254d3560065c4d8a8aaf312870be2967 and project 6981486a29b64ee7b9ef7cbf2ca852be. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:36:01 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:36:01 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:36:01 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 1.251384 Apr 12 10:36:01 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 40/118] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 10:36:00 2023] POST /compute/v2.1/servers => generated 404 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 10:36:01 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-83affabb-15e1-49f3-b383-7779b89506a9 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:36:01 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-83affabb-15e1-49f3-b383-7779b89506a9 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:36:01 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-83affabb-15e1-49f3-b383-7779b89506a9 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '254d3560065c4d8a8aaf312870be2967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6981486a29b64ee7b9ef7cbf2ca852be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:01 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-83affabb-15e1-49f3-b383-7779b89506a9 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '254d3560065c4d8a8aaf312870be2967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6981486a29b64ee7b9ef7cbf2ca852be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:01 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-83affabb-15e1-49f3-b383-7779b89506a9 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '254d3560065c4d8a8aaf312870be2967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6981486a29b64ee7b9ef7cbf2ca852be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:01 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-83affabb-15e1-49f3-b383-7779b89506a9 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266" status: 200 len: 1320 microversion: 2.49 time: 0.156826 Apr 12 10:36:01 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 38/119] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:36:01 2023] GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266 => generated 1320 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:36:02 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d04cb526-f77a-457c-90b1-3e5c202c0c30", "name": "network-vif-plugged", "status": "completed", "tag": "d6cd169f-f736-45da-96ea-c0b933c882a0"}, {"server_uuid": "ea55f551-968e-4ece-a37a-c4128ce5e8cb", "name": "network-vif-plugged", "status": "completed", "tag": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7"}, {"server_uuid": "ea55f551-968e-4ece-a37a-c4128ce5e8cb", "name": "network-vif-plugged", "status": "completed", "tag": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] Creating event network-vif-plugged:d6cd169f-f736-45da-96ea-c0b933c882a0 for instance d04cb526-f77a-457c-90b1-3e5c202c0c30 on user Apr 12 10:36:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] Creating event network-vif-plugged:9d4bc0b7-4a2b-4354-a609-c673f6235cc7 for instance ea55f551-968e-4ece-a37a-c4128ce5e8cb on user Apr 12 10:36:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] Creating event network-vif-plugged:9d4bc0b7-4a2b-4354-a609-c673f6235cc7 for instance ea55f551-968e-4ece-a37a-c4128ce5e8cb on user Apr 12 10:36:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.050169 Apr 12 10:36:02 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 42/120] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:36:02 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:36:04 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-9286c6a5-d372-40c1-a9ff-f854ff74e066 req-8c821872-096c-4986-947a-c68506960d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f147b4ee-d130-41ae-a4db-bc248fb23266", "tag": "96998164-acd9-4a18-b230-d63787eaf154"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9286c6a5-d372-40c1-a9ff-f854ff74e066 req-8c821872-096c-4986-947a-c68506960d00 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9286c6a5-d372-40c1-a9ff-f854ff74e066 req-8c821872-096c-4986-947a-c68506960d00 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9286c6a5-d372-40c1-a9ff-f854ff74e066 req-8c821872-096c-4986-947a-c68506960d00 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:04 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d261c30-0c6f-4d1b-8965-448dc019728e", "name": "network-vif-plugged", "status": "completed", "tag": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38"}, {"server_uuid": "3d261c30-0c6f-4d1b-8965-448dc019728e", "name": "network-vif-plugged", "status": "completed", "tag": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-9286c6a5-d372-40c1-a9ff-f854ff74e066 req-8c821872-096c-4986-947a-c68506960d00 service nova] Creating event network-changed:96998164-acd9-4a18-b230-d63787eaf154 for instance f147b4ee-d130-41ae-a4db-bc248fb23266 on user Apr 12 10:36:04 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:04 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=21 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:04 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] Creating event network-vif-plugged:166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 for instance 3d261c30-0c6f-4d1b-8965-448dc019728e on user Apr 12 10:36:04 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] Creating event network-vif-plugged:166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 for instance 3d261c30-0c6f-4d1b-8965-448dc019728e on user Apr 12 10:36:04 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047084 Apr 12 10:36:04 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 39/121] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:36:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:36:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-9286c6a5-d372-40c1-a9ff-f854ff74e066 req-8c821872-096c-4986-947a-c68506960d00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085593 Apr 12 10:36:04 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 41/122] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:36:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:36:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-99f1a30a-51ad-4bf2-b34d-5fde3f86f76a req-53ec995f-3771-4d50-9439-5a581a17120b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f147b4ee-d130-41ae-a4db-bc248fb23266", "name": "network-vif-plugged", "status": "completed", "tag": "96998164-acd9-4a18-b230-d63787eaf154"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:07 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=12 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-99f1a30a-51ad-4bf2-b34d-5fde3f86f76a req-53ec995f-3771-4d50-9439-5a581a17120b service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-99f1a30a-51ad-4bf2-b34d-5fde3f86f76a req-53ec995f-3771-4d50-9439-5a581a17120b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-99f1a30a-51ad-4bf2-b34d-5fde3f86f76a req-53ec995f-3771-4d50-9439-5a581a17120b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-99f1a30a-51ad-4bf2-b34d-5fde3f86f76a req-53ec995f-3771-4d50-9439-5a581a17120b service nova] Creating event network-vif-plugged:96998164-acd9-4a18-b230-d63787eaf154 for instance f147b4ee-d130-41ae-a4db-bc248fb23266 on user Apr 12 10:36:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-99f1a30a-51ad-4bf2-b34d-5fde3f86f76a req-53ec995f-3771-4d50-9439-5a581a17120b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096102 Apr 12 10:36:07 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 43/123] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:36:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:36:09 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-a83173f0-73b1-4fc4-87e6-e90fe38939e7 req-44f1286b-54c4-4b1e-9d6f-f482f4f70e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f147b4ee-d130-41ae-a4db-bc248fb23266", "name": "network-vif-plugged", "status": "completed", "tag": "96998164-acd9-4a18-b230-d63787eaf154"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-a83173f0-73b1-4fc4-87e6-e90fe38939e7 req-44f1286b-54c4-4b1e-9d6f-f482f4f70e3a service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-a83173f0-73b1-4fc4-87e6-e90fe38939e7 req-44f1286b-54c4-4b1e-9d6f-f482f4f70e3a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-a83173f0-73b1-4fc4-87e6-e90fe38939e7 req-44f1286b-54c4-4b1e-9d6f-f482f4f70e3a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:09 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-a83173f0-73b1-4fc4-87e6-e90fe38939e7 req-44f1286b-54c4-4b1e-9d6f-f482f4f70e3a service nova] Creating event network-vif-plugged:96998164-acd9-4a18-b230-d63787eaf154 for instance f147b4ee-d130-41ae-a4db-bc248fb23266 on user Apr 12 10:36:09 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-a83173f0-73b1-4fc4-87e6-e90fe38939e7 req-44f1286b-54c4-4b1e-9d6f-f482f4f70e3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038458 Apr 12 10:36:09 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 40/124] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:36:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:36:14 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:14 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=22 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:14 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-161a1181-64e9-4c1d-a40e-621d2200fdcf tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Action: 'create', calling method: .version_select at 0x7fabc05dd090>, body: {"keypair": {"name": "tempest-keypair-1600069342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg=="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:14 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-161a1181-64e9-4c1d-a40e-621d2200fdcf tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Getting quotas for project 1fcfbd94249342b2a436d2592e0dc9bf. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:36:14 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-161a1181-64e9-4c1d-a40e-621d2200fdcf tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Getting quotas for user 949ebef2d45b4d64a89a11d837dfffd3 and project 1fcfbd94249342b2a436d2592e0dc9bf. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:36:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-161a1181-64e9-4c1d-a40e-621d2200fdcf tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.104944 Apr 12 10:36:14 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 42/125] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 10:36:14 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 10:36:15 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-eaaf4e63-982e-4637-b012-7dc8d6d7feb6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:36:15 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-eaaf4e63-982e-4637-b012-7dc8d6d7feb6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:36:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eaaf4e63-982e-4637-b012-7dc8d6d7feb6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eaaf4e63-982e-4637-b012-7dc8d6d7feb6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eaaf4e63-982e-4637-b012-7dc8d6d7feb6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eaaf4e63-982e-4637-b012-7dc8d6d7feb6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eaaf4e63-982e-4637-b012-7dc8d6d7feb6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eaaf4e63-982e-4637-b012-7dc8d6d7feb6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:15 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-eaaf4e63-982e-4637-b012-7dc8d6d7feb6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:15 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-eaaf4e63-982e-4637-b012-7dc8d6d7feb6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:15 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-eaaf4e63-982e-4637-b012-7dc8d6d7feb6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-eaaf4e63-982e-4637-b012-7dc8d6d7feb6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f55cab4-8530-4be0-a91d-65671f0dccd9" status: 200 len: 1688 microversion: 2.87 time: 0.251358 Apr 12 10:36:15 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 44/126] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:36:15 2023] GET /compute/v2.1/servers/0f55cab4-8530-4be0-a91d-65671f0dccd9 => generated 1688 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:36:15 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=14 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:15 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-294974011", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "487a3034-5a63-4896-a029-be581b719991"}, {"port": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "tag": "port-1"}, {"port": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "tag": "port-2"}, {"uuid": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "tag": "net-1"}, {"uuid": "5c74f6a2-2fbf-4117-85df-6a7abb02577c"}, {"uuid": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "eb1f25c3-c274-4c2d-b5be-af3f13f3e84f", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7b206a0b-d64c-4f10-b072-f1473bf5f2ca", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--222095010"}], "key_name": "tempest-keypair-1600069342", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:15 user devstack@n-api.service[61852]: DEBUG nova.network.neutron [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] validate_networks() for [('487a3034-5a63-4896-a029-be581b719991', None, None, None, None, None), (None, None, 'c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5', None, None, None), (None, None, '307fee9a-af5f-45a9-b678-7cb16cfad99d', None, None, None), ('5c74f6a2-2fbf-4117-85df-6a7abb02577c', None, None, None, None, None), ('5c74f6a2-2fbf-4117-85df-6a7abb02577c', None, None, None, None, None), ('47aa3673-739f-40a5-90b5-9bdc59b7590c', '10.2.2.100', None, None, None, None), ('47aa3673-739f-40a5-90b5-9bdc59b7590c', '10.2.2.200', None, None, None, None)] {{(pid=61852) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:36:17 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b9ca76f6-121d-4b66-85fc-ff32f6a3d28c tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:36:17 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-b9ca76f6-121d-4b66-85fc-ff32f6a3d28c tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:36:17 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=7 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b9ca76f6-121d-4b66-85fc-ff32f6a3d28c tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b9ca76f6-121d-4b66-85fc-ff32f6a3d28c tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b9ca76f6-121d-4b66-85fc-ff32f6a3d28c tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b9ca76f6-121d-4b66-85fc-ff32f6a3d28c tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b9ca76f6-121d-4b66-85fc-ff32f6a3d28c tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b9ca76f6-121d-4b66-85fc-ff32f6a3d28c tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:18 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-b9ca76f6-121d-4b66-85fc-ff32f6a3d28c tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c757f04065b9488ba75739e59d7be377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce2a3bde13e464f8df0a41f30c240ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:18 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b9ca76f6-121d-4b66-85fc-ff32f6a3d28c tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5" status: 200 len: 1553 microversion: 2.1 time: 0.321514 Apr 12 10:36:18 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 43/127] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:36:17 2023] GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5 => generated 1553 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:36:18 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Flavor limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:36:18 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Image limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:36:18 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Flavor pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:36:18 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Image pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:36:18 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:36:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:18 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Getting quotas for project 1fcfbd94249342b2a436d2592e0dc9bf. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:36:18 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Getting quotas for user 949ebef2d45b4d64a89a11d837dfffd3 and project 1fcfbd94249342b2a436d2592e0dc9bf. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:36:18 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Going to run 1 instances... {{(pid=61852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:36:18 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='eb1f25c3-c274-4c2d-b5be-af3f13f3e84f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b206a0b-d64c-4f10-b072-f1473bf5f2ca',volume_size=None,volume_type=None)] {{(pid=61852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:36:18 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 3.059787 Apr 12 10:36:18 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 41/128] 10.0.0.210 () {66 vars in 1266 bytes} [Wed Apr 12 10:36:15 2023] POST /compute/v2.1/servers => generated 403 bytes in 3061 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 10:36:18 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8f453b69-c62e-468e-9ec3-c14f828d82da tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:36:18 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-8f453b69-c62e-468e-9ec3-c14f828d82da tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:36:18 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-8f453b69-c62e-468e-9ec3-c14f828d82da tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949ebef2d45b4d64a89a11d837dfffd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcfbd94249342b2a436d2592e0dc9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:18 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-8f453b69-c62e-468e-9ec3-c14f828d82da tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '949ebef2d45b4d64a89a11d837dfffd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcfbd94249342b2a436d2592e0dc9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:18 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-8f453b69-c62e-468e-9ec3-c14f828d82da tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '949ebef2d45b4d64a89a11d837dfffd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcfbd94249342b2a436d2592e0dc9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:18 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8f453b69-c62e-468e-9ec3-c14f828d82da tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3" status: 200 len: 1279 microversion: 2.42 time: 0.078694 Apr 12 10:36:18 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 45/129] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:36:18 2023] GET /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3 => generated 1279 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:36:19 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-c5e4d424-3a33-444a-bf47-352d9b9c3f2c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:36:19 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-c5e4d424-3a33-444a-bf47-352d9b9c3f2c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:36:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c5e4d424-3a33-444a-bf47-352d9b9c3f2c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c5e4d424-3a33-444a-bf47-352d9b9c3f2c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c5e4d424-3a33-444a-bf47-352d9b9c3f2c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c5e4d424-3a33-444a-bf47-352d9b9c3f2c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c5e4d424-3a33-444a-bf47-352d9b9c3f2c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c5e4d424-3a33-444a-bf47-352d9b9c3f2c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:19 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-c5e4d424-3a33-444a-bf47-352d9b9c3f2c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:19 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-c5e4d424-3a33-444a-bf47-352d9b9c3f2c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1539 microversion: 2.1 time: 0.150082 Apr 12 10:36:19 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 44/130] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:36:19 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1539 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:36:22 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-85bbf003-3043-4586-af47-d4cce63c2073 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:36:22 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-85bbf003-3043-4586-af47-d4cce63c2073 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:36:22 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=7 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-85bbf003-3043-4586-af47-d4cce63c2073 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-85bbf003-3043-4586-af47-d4cce63c2073 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-85bbf003-3043-4586-af47-d4cce63c2073 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-85bbf003-3043-4586-af47-d4cce63c2073 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-85bbf003-3043-4586-af47-d4cce63c2073 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-85bbf003-3043-4586-af47-d4cce63c2073 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:23 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-85bbf003-3043-4586-af47-d4cce63c2073 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d19bfc4894401cb664521438338b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024682bfda5548b8b9b404c85dd55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:23 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-85bbf003-3043-4586-af47-d4cce63c2073 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586" status: 200 len: 1492 microversion: 2.1 time: 0.341990 Apr 12 10:36:23 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 42/131] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:36:22 2023] GET /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586 => generated 1492 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:36:24 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-7f9d5049-d4a0-4710-b672-d921b342d57a req-cd2fe095-ce2a-4576-8a5d-f361f66ba62a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "tag": "fe31a29c-b57d-463d-98ba-6527848edeba"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:24 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-7f9d5049-d4a0-4710-b672-d921b342d57a req-cd2fe095-ce2a-4576-8a5d-f361f66ba62a service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-7f9d5049-d4a0-4710-b672-d921b342d57a req-cd2fe095-ce2a-4576-8a5d-f361f66ba62a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-7f9d5049-d4a0-4710-b672-d921b342d57a req-cd2fe095-ce2a-4576-8a5d-f361f66ba62a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:24 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=21 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:24 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-7f9d5049-d4a0-4710-b672-d921b342d57a req-cd2fe095-ce2a-4576-8a5d-f361f66ba62a service nova] Creating event network-changed:fe31a29c-b57d-463d-98ba-6527848edeba for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:24 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-7f9d5049-d4a0-4710-b672-d921b342d57a req-cd2fe095-ce2a-4576-8a5d-f361f66ba62a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040067 Apr 12 10:36:24 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 46/132] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:36:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:36:25 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:25 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-06199bba-cb4a-41c4-9319-717d66fbfcf3 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:36:25 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-06199bba-cb4a-41c4-9319-717d66fbfcf3 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:36:25 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=11 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-06199bba-cb4a-41c4-9319-717d66fbfcf3 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-06199bba-cb4a-41c4-9319-717d66fbfcf3 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-06199bba-cb4a-41c4-9319-717d66fbfcf3 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-06199bba-cb4a-41c4-9319-717d66fbfcf3 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-06199bba-cb4a-41c4-9319-717d66fbfcf3 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-06199bba-cb4a-41c4-9319-717d66fbfcf3 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:25 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-06199bba-cb4a-41c4-9319-717d66fbfcf3 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3766c8ddd6ae4fdd9d4aa6929cc080cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dbf247dab94f6eb32e7808314d420a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-06199bba-cb4a-41c4-9319-717d66fbfcf3 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3" status: 200 len: 1490 microversion: 2.1 time: 0.317968 Apr 12 10:36:25 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 45/133] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:36:25 2023] GET /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3 => generated 1490 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:36:26 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-deaef6e3-76d3-4dc6-83ee-db8379b1e72d req-b18399fd-654b-4e00-b1f1-0653d3a4565d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "tag": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-deaef6e3-76d3-4dc6-83ee-db8379b1e72d req-b18399fd-654b-4e00-b1f1-0653d3a4565d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-deaef6e3-76d3-4dc6-83ee-db8379b1e72d req-b18399fd-654b-4e00-b1f1-0653d3a4565d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-deaef6e3-76d3-4dc6-83ee-db8379b1e72d req-b18399fd-654b-4e00-b1f1-0653d3a4565d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:26 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-deaef6e3-76d3-4dc6-83ee-db8379b1e72d req-b18399fd-654b-4e00-b1f1-0653d3a4565d service nova] Creating event network-changed:c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:26 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-deaef6e3-76d3-4dc6-83ee-db8379b1e72d req-b18399fd-654b-4e00-b1f1-0653d3a4565d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031206 Apr 12 10:36:26 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 43/134] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:36:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:36:27 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-cb5eaf7f-93da-492b-89f0-4f81cd375bc0 req-6dcafe07-fd5b-4126-b686-39604388dfcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "tag": "1173b214-caa3-4d2b-9ee4-efe4ab063cac"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cb5eaf7f-93da-492b-89f0-4f81cd375bc0 req-6dcafe07-fd5b-4126-b686-39604388dfcb service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cb5eaf7f-93da-492b-89f0-4f81cd375bc0 req-6dcafe07-fd5b-4126-b686-39604388dfcb service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cb5eaf7f-93da-492b-89f0-4f81cd375bc0 req-6dcafe07-fd5b-4126-b686-39604388dfcb service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:27 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-cb5eaf7f-93da-492b-89f0-4f81cd375bc0 req-6dcafe07-fd5b-4126-b686-39604388dfcb service nova] Creating event network-changed:1173b214-caa3-4d2b-9ee4-efe4ab063cac for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:27 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-cb5eaf7f-93da-492b-89f0-4f81cd375bc0 req-6dcafe07-fd5b-4126-b686-39604388dfcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035907 Apr 12 10:36:27 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 47/135] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:36:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:36:28 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-2412f8b5-5c12-4994-9a66-f5e0abb6ecde req-ee91858e-cf77-49ae-b0c6-6d4bafc18b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "tag": "307fee9a-af5f-45a9-b678-7cb16cfad99d"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2412f8b5-5c12-4994-9a66-f5e0abb6ecde req-ee91858e-cf77-49ae-b0c6-6d4bafc18b88 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2412f8b5-5c12-4994-9a66-f5e0abb6ecde req-ee91858e-cf77-49ae-b0c6-6d4bafc18b88 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2412f8b5-5c12-4994-9a66-f5e0abb6ecde req-ee91858e-cf77-49ae-b0c6-6d4bafc18b88 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:28 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-2412f8b5-5c12-4994-9a66-f5e0abb6ecde req-ee91858e-cf77-49ae-b0c6-6d4bafc18b88 service nova] Creating event network-changed:307fee9a-af5f-45a9-b678-7cb16cfad99d for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:28 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-2412f8b5-5c12-4994-9a66-f5e0abb6ecde req-ee91858e-cf77-49ae-b0c6-6d4bafc18b88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030390 Apr 12 10:36:28 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 46/136] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:36:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:36:29 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:29 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:29 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "tag": "925f7823-924b-4df5-8bec-5f065331e4fe"}, {"name": "network-changed", "server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "tag": "23c5dfaa-4003-410d-836e-4218b879cf66"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:29 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:29 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:29 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:29 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] Creating event network-changed:925f7823-924b-4df5-8bec-5f065331e4fe for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:29 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] Creating event network-changed:23c5dfaa-4003-410d-836e-4218b879cf66 for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:29 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032362 Apr 12 10:36:29 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 44/137] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:36:29 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:36:31 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-2c695850-e9a1-4838-b74d-90c2e27882f0 req-efaa2a90-ad47-4ef0-b953-da9bf55f7802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "tag": "718755e4-0ae2-47c0-b5c9-630c5df1e840"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-2c695850-e9a1-4838-b74d-90c2e27882f0 req-efaa2a90-ad47-4ef0-b953-da9bf55f7802 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-2c695850-e9a1-4838-b74d-90c2e27882f0 req-efaa2a90-ad47-4ef0-b953-da9bf55f7802 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-2c695850-e9a1-4838-b74d-90c2e27882f0 req-efaa2a90-ad47-4ef0-b953-da9bf55f7802 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-2c695850-e9a1-4838-b74d-90c2e27882f0 req-efaa2a90-ad47-4ef0-b953-da9bf55f7802 service nova] Creating event network-changed:718755e4-0ae2-47c0-b5c9-630c5df1e840 for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-2c695850-e9a1-4838-b74d-90c2e27882f0 req-efaa2a90-ad47-4ef0-b953-da9bf55f7802 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035517 Apr 12 10:36:31 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 48/138] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:36:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:36:42 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:42 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=20 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:42 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-081eba88-47ba-4adf-8017-db1af17e15e6 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:36:42 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-081eba88-47ba-4adf-8017-db1af17e15e6 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:36:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-081eba88-47ba-4adf-8017-db1af17e15e6 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-081eba88-47ba-4adf-8017-db1af17e15e6 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-081eba88-47ba-4adf-8017-db1af17e15e6 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-081eba88-47ba-4adf-8017-db1af17e15e6 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-081eba88-47ba-4adf-8017-db1af17e15e6 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-081eba88-47ba-4adf-8017-db1af17e15e6 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:43 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=5 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:43 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=15 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:43 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-0dea8ac6-2ace-48a0-9091-cf53e04d7b2e req-11a206ad-8c69-4a65-9bf8-96e9e61ec9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "fe31a29c-b57d-463d-98ba-6527848edeba"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:43 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-081eba88-47ba-4adf-8017-db1af17e15e6 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a2243c6c9f431da846cc54ec181fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb8217b1544db384bebe1059848bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:43 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-081eba88-47ba-4adf-8017-db1af17e15e6 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30" status: 200 len: 1544 microversion: 2.1 time: 0.186044 Apr 12 10:36:43 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 47/139] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:36:42 2023] GET /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30 => generated 1544 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:36:43 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-0dea8ac6-2ace-48a0-9091-cf53e04d7b2e req-11a206ad-8c69-4a65-9bf8-96e9e61ec9c1 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:43 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-0dea8ac6-2ace-48a0-9091-cf53e04d7b2e req-11a206ad-8c69-4a65-9bf8-96e9e61ec9c1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:43 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-0dea8ac6-2ace-48a0-9091-cf53e04d7b2e req-11a206ad-8c69-4a65-9bf8-96e9e61ec9c1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:43 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-0dea8ac6-2ace-48a0-9091-cf53e04d7b2e req-11a206ad-8c69-4a65-9bf8-96e9e61ec9c1 service nova] Creating event network-vif-plugged:fe31a29c-b57d-463d-98ba-6527848edeba for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:43 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-0dea8ac6-2ace-48a0-9091-cf53e04d7b2e req-11a206ad-8c69-4a65-9bf8-96e9e61ec9c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040346 Apr 12 10:36:43 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 45/140] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:36:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:36:43 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=5 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:43 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=5 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-e9558555-f33d-4494-a673-bf4106c19691 req-8e47d134-be34-49e3-aefc-35ef5fdfe645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e9558555-f33d-4494-a673-bf4106c19691 req-8e47d134-be34-49e3-aefc-35ef5fdfe645 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e9558555-f33d-4494-a673-bf4106c19691 req-8e47d134-be34-49e3-aefc-35ef5fdfe645 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e9558555-f33d-4494-a673-bf4106c19691 req-8e47d134-be34-49e3-aefc-35ef5fdfe645 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e9558555-f33d-4494-a673-bf4106c19691 req-8e47d134-be34-49e3-aefc-35ef5fdfe645 service nova] Creating event network-vif-plugged:c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-e9558555-f33d-4494-a673-bf4106c19691 req-8e47d134-be34-49e3-aefc-35ef5fdfe645 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037124 Apr 12 10:36:43 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 49/141] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:36:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:36:44 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-44d103aa-7c29-4364-89d4-5f6c3539e442 req-c2a55ee7-094f-4b8e-8b14-460815296572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "1173b214-caa3-4d2b-9ee4-efe4ab063cac"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-44d103aa-7c29-4364-89d4-5f6c3539e442 req-c2a55ee7-094f-4b8e-8b14-460815296572 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-44d103aa-7c29-4364-89d4-5f6c3539e442 req-c2a55ee7-094f-4b8e-8b14-460815296572 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-44d103aa-7c29-4364-89d4-5f6c3539e442 req-c2a55ee7-094f-4b8e-8b14-460815296572 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-44d103aa-7c29-4364-89d4-5f6c3539e442 req-c2a55ee7-094f-4b8e-8b14-460815296572 service nova] Creating event network-vif-plugged:1173b214-caa3-4d2b-9ee4-efe4ab063cac for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-44d103aa-7c29-4364-89d4-5f6c3539e442 req-c2a55ee7-094f-4b8e-8b14-460815296572 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030669 Apr 12 10:36:44 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 48/142] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:36:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:36:44 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-25c434be-3ca7-4b7e-866c-70e7d8d01969 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:36:44 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-25c434be-3ca7-4b7e-866c-70e7d8d01969 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:36:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-25c434be-3ca7-4b7e-866c-70e7d8d01969 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-25c434be-3ca7-4b7e-866c-70e7d8d01969 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-25c434be-3ca7-4b7e-866c-70e7d8d01969 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-25c434be-3ca7-4b7e-866c-70e7d8d01969 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-25c434be-3ca7-4b7e-866c-70e7d8d01969 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-25c434be-3ca7-4b7e-866c-70e7d8d01969 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:44 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-25c434be-3ca7-4b7e-866c-70e7d8d01969 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80dbdeaccf84466286a6d85921e15a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b7b715cc24490ebd04d5469b6e07ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:44 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-25c434be-3ca7-4b7e-866c-70e7d8d01969 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb" status: 200 len: 1527 microversion: 2.1 time: 0.162211 Apr 12 10:36:44 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 46/143] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:36:44 2023] GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb => generated 1527 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:36:45 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-3a314bd6-7bd9-4196-aabb-d2e4530b05ec req-e0679357-fad4-4e9b-96c5-1c4765bd8d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "fe31a29c-b57d-463d-98ba-6527848edeba"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3a314bd6-7bd9-4196-aabb-d2e4530b05ec req-e0679357-fad4-4e9b-96c5-1c4765bd8d87 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3a314bd6-7bd9-4196-aabb-d2e4530b05ec req-e0679357-fad4-4e9b-96c5-1c4765bd8d87 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3a314bd6-7bd9-4196-aabb-d2e4530b05ec req-e0679357-fad4-4e9b-96c5-1c4765bd8d87 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:45 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-3a314bd6-7bd9-4196-aabb-d2e4530b05ec req-e0679357-fad4-4e9b-96c5-1c4765bd8d87 service nova] Creating event network-vif-plugged:fe31a29c-b57d-463d-98ba-6527848edeba for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:45 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-3a314bd6-7bd9-4196-aabb-d2e4530b05ec req-e0679357-fad4-4e9b-96c5-1c4765bd8d87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185571 Apr 12 10:36:45 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 50/144] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:36:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:36:45 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "307fee9a-af5f-45a9-b678-7cb16cfad99d"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "307fee9a-af5f-45a9-b678-7cb16cfad99d"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] Creating event network-vif-plugged:c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] Creating event network-vif-plugged:307fee9a-af5f-45a9-b678-7cb16cfad99d for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] Creating event network-vif-plugged:307fee9a-af5f-45a9-b678-7cb16cfad99d for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.030627 Apr 12 10:36:45 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 49/145] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:36:45 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:36:46 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "1173b214-caa3-4d2b-9ee4-efe4ab063cac"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "925f7823-924b-4df5-8bec-5f065331e4fe"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "925f7823-924b-4df5-8bec-5f065331e4fe"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "23c5dfaa-4003-410d-836e-4218b879cf66"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "23c5dfaa-4003-410d-836e-4218b879cf66"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "718755e4-0ae2-47c0-b5c9-630c5df1e840"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "718755e4-0ae2-47c0-b5c9-630c5df1e840"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:36:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Creating event network-vif-plugged:1173b214-caa3-4d2b-9ee4-efe4ab063cac for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Creating event network-vif-plugged:925f7823-924b-4df5-8bec-5f065331e4fe for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Creating event network-vif-plugged:925f7823-924b-4df5-8bec-5f065331e4fe for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Creating event network-vif-plugged:23c5dfaa-4003-410d-836e-4218b879cf66 for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Creating event network-vif-plugged:23c5dfaa-4003-410d-836e-4218b879cf66 for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Creating event network-vif-plugged:718755e4-0ae2-47c0-b5c9-630c5df1e840 for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Creating event network-vif-plugged:718755e4-0ae2-47c0-b5c9-630c5df1e840 for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:36:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.033856 Apr 12 10:36:46 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 47/146] 10.0.0.210 () {68 vars in 1395 bytes} [Wed Apr 12 10:36:46 2023] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:36:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f0cb978a-9d05-4def-8184-4bbc5c398a9c tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:36:47 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f0cb978a-9d05-4def-8184-4bbc5c398a9c tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:36:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f0cb978a-9d05-4def-8184-4bbc5c398a9c tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f0cb978a-9d05-4def-8184-4bbc5c398a9c tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f0cb978a-9d05-4def-8184-4bbc5c398a9c tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f0cb978a-9d05-4def-8184-4bbc5c398a9c tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f0cb978a-9d05-4def-8184-4bbc5c398a9c tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f0cb978a-9d05-4def-8184-4bbc5c398a9c tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:47 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-f0cb978a-9d05-4def-8184-4bbc5c398a9c tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f1517aae734c8aa5b0acbc906af9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cede3351295e451283a0414aefea1de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f0cb978a-9d05-4def-8184-4bbc5c398a9c tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e" status: 200 len: 1548 microversion: 2.1 time: 0.157785 Apr 12 10:36:47 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 51/147] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:36:47 2023] GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:36:51 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0071809f-0d93-4b6d-bf37-16099d802c71 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:36:51 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-0071809f-0d93-4b6d-bf37-16099d802c71 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:36:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0071809f-0d93-4b6d-bf37-16099d802c71 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0071809f-0d93-4b6d-bf37-16099d802c71 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0071809f-0d93-4b6d-bf37-16099d802c71 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0071809f-0d93-4b6d-bf37-16099d802c71 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0071809f-0d93-4b6d-bf37-16099d802c71 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0071809f-0d93-4b6d-bf37-16099d802c71 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:52 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-0071809f-0d93-4b6d-bf37-16099d802c71 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '254d3560065c4d8a8aaf312870be2967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6981486a29b64ee7b9ef7cbf2ca852be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:52 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-0071809f-0d93-4b6d-bf37-16099d802c71 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '254d3560065c4d8a8aaf312870be2967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6981486a29b64ee7b9ef7cbf2ca852be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:52 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-0071809f-0d93-4b6d-bf37-16099d802c71 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '254d3560065c4d8a8aaf312870be2967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6981486a29b64ee7b9ef7cbf2ca852be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:36:52 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-0071809f-0d93-4b6d-bf37-16099d802c71 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266" status: 200 len: 1626 microversion: 2.49 time: 0.206884 Apr 12 10:36:52 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 50/148] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:36:51 2023] GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266 => generated 1626 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:36:59 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:59 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=10 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:59 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:36:59 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:36:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:59 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:36:59 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/270d5d4d-4df6-4ba5-9145-98f343fb3b0e" status: 204 len: 0 microversion: 2.1 time: 0.173182 Apr 12 10:36:59 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 48/149] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:36:59 2023] DELETE /compute/v2.1/servers/270d5d4d-4df6-4ba5-9145-98f343fb3b0e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:36:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-fb5e2860-6161-4a89-9231-906e199336c3 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:36:59 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-fb5e2860-6161-4a89-9231-906e199336c3 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:36:59 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:59 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=10 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:36:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fb5e2860-6161-4a89-9231-906e199336c3 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fb5e2860-6161-4a89-9231-906e199336c3 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fb5e2860-6161-4a89-9231-906e199336c3 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:36:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fb5e2860-6161-4a89-9231-906e199336c3 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:36:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fb5e2860-6161-4a89-9231-906e199336c3 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:36:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fb5e2860-6161-4a89-9231-906e199336c3 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-54998032-be3f-4f9c-8b20-91037b76c8a0 req-8f698108-1506-4270-a3b3-29f649e492a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270d5d4d-4df6-4ba5-9145-98f343fb3b0e", "name": "network-vif-unplugged", "status": "completed", "tag": "42768d69-c7da-43fb-b092-c5b41ac2d55c"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-54998032-be3f-4f9c-8b20-91037b76c8a0 req-8f698108-1506-4270-a3b3-29f649e492a6 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-54998032-be3f-4f9c-8b20-91037b76c8a0 req-8f698108-1506-4270-a3b3-29f649e492a6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-54998032-be3f-4f9c-8b20-91037b76c8a0 req-8f698108-1506-4270-a3b3-29f649e492a6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-54998032-be3f-4f9c-8b20-91037b76c8a0 req-8f698108-1506-4270-a3b3-29f649e492a6 service nova] Creating event network-vif-unplugged:42768d69-c7da-43fb-b092-c5b41ac2d55c for instance 270d5d4d-4df6-4ba5-9145-98f343fb3b0e on user Apr 12 10:37:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-54998032-be3f-4f9c-8b20-91037b76c8a0 req-8f698108-1506-4270-a3b3-29f649e492a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035436 Apr 12 10:37:00 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 51/150] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:37:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:00 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-fb5e2860-6161-4a89-9231-906e199336c3 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064f86e997904027aa9f086e3b137916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8cbfbed2c843f796e810c6cc8530ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:37:00 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-fb5e2860-6161-4a89-9231-906e199336c3 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] 10.0.0.210 "GET /compute/v2.1/servers/270d5d4d-4df6-4ba5-9145-98f343fb3b0e" status: 200 len: 1460 microversion: 2.1 time: 0.595520 Apr 12 10:37:00 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 52/151] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:36:59 2023] GET /compute/v2.1/servers/270d5d4d-4df6-4ba5-9145-98f343fb3b0e => generated 1460 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:37:01 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-b9906f31-0a8e-4a48-b5ed-3d5f399e8d81 req-e00859b4-d3a6-44db-b460-75e426b788dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270d5d4d-4df6-4ba5-9145-98f343fb3b0e", "name": "network-vif-deleted", "tag": "42768d69-c7da-43fb-b092-c5b41ac2d55c"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-b9906f31-0a8e-4a48-b5ed-3d5f399e8d81 req-e00859b4-d3a6-44db-b460-75e426b788dc service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-b9906f31-0a8e-4a48-b5ed-3d5f399e8d81 req-e00859b4-d3a6-44db-b460-75e426b788dc service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-b9906f31-0a8e-4a48-b5ed-3d5f399e8d81 req-e00859b4-d3a6-44db-b460-75e426b788dc service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:01 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-b9906f31-0a8e-4a48-b5ed-3d5f399e8d81 req-e00859b4-d3a6-44db-b460-75e426b788dc service nova] Creating event network-vif-deleted:42768d69-c7da-43fb-b092-c5b41ac2d55c for instance 270d5d4d-4df6-4ba5-9145-98f343fb3b0e on user Apr 12 10:37:01 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-b9906f31-0a8e-4a48-b5ed-3d5f399e8d81 req-e00859b4-d3a6-44db-b460-75e426b788dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233888 Apr 12 10:37:01 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 49/152] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:37:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:02 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-09b059f1-5528-4483-8a9d-8aec010c0285 req-b24dda5f-6bf9-452b-bc20-68ffcc054ffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270d5d4d-4df6-4ba5-9145-98f343fb3b0e", "name": "network-vif-plugged", "status": "completed", "tag": "42768d69-c7da-43fb-b092-c5b41ac2d55c"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-09b059f1-5528-4483-8a9d-8aec010c0285 req-b24dda5f-6bf9-452b-bc20-68ffcc054ffb service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-09b059f1-5528-4483-8a9d-8aec010c0285 req-b24dda5f-6bf9-452b-bc20-68ffcc054ffb service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-09b059f1-5528-4483-8a9d-8aec010c0285 req-b24dda5f-6bf9-452b-bc20-68ffcc054ffb service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-09b059f1-5528-4483-8a9d-8aec010c0285 req-b24dda5f-6bf9-452b-bc20-68ffcc054ffb service nova] Creating event network-vif-plugged:42768d69-c7da-43fb-b092-c5b41ac2d55c for instance 270d5d4d-4df6-4ba5-9145-98f343fb3b0e on user Apr 12 10:37:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-09b059f1-5528-4483-8a9d-8aec010c0285 req-b24dda5f-6bf9-452b-bc20-68ffcc054ffb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029381 Apr 12 10:37:02 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 52/153] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:37:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:08 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-12ee9860-98e5-455e-bf77-b98979cf4bb8 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:08 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-12ee9860-98e5-455e-bf77-b98979cf4bb8 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-12ee9860-98e5-455e-bf77-b98979cf4bb8 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-12ee9860-98e5-455e-bf77-b98979cf4bb8 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-12ee9860-98e5-455e-bf77-b98979cf4bb8 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-12ee9860-98e5-455e-bf77-b98979cf4bb8 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-12ee9860-98e5-455e-bf77-b98979cf4bb8 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-12ee9860-98e5-455e-bf77-b98979cf4bb8 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:09 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-12ee9860-98e5-455e-bf77-b98979cf4bb8 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949ebef2d45b4d64a89a11d837dfffd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcfbd94249342b2a436d2592e0dc9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:37:09 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-12ee9860-98e5-455e-bf77-b98979cf4bb8 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '949ebef2d45b4d64a89a11d837dfffd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcfbd94249342b2a436d2592e0dc9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:37:09 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-12ee9860-98e5-455e-bf77-b98979cf4bb8 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '949ebef2d45b4d64a89a11d837dfffd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcfbd94249342b2a436d2592e0dc9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:37:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-12ee9860-98e5-455e-bf77-b98979cf4bb8 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3" status: 200 len: 2820 microversion: 2.42 time: 0.240482 Apr 12 10:37:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 53/154] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:37:08 2023] GET /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3 => generated 2820 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:37:15 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:37:15 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:37:15 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-385826519"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:15 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:16 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0f55cab4-8530-4be0-a91d-65671f0dccd9/action" status: 202 len: 52 microversion: 2.87 time: 0.780094 Apr 12 10:37:16 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 50/155] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 10:37:15 2023] POST /compute/v2.1/servers/0f55cab4-8530-4be0-a91d-65671f0dccd9/action => generated 52 bytes in 782 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 12 10:37:18 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2370727e-a46f-439c-8d49-d39c55d14edb tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:18 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-2370727e-a46f-439c-8d49-d39c55d14edb tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:18 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=12 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:37:18 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=20 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:37:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2370727e-a46f-439c-8d49-d39c55d14edb tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2370727e-a46f-439c-8d49-d39c55d14edb tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2370727e-a46f-439c-8d49-d39c55d14edb tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2370727e-a46f-439c-8d49-d39c55d14edb tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2370727e-a46f-439c-8d49-d39c55d14edb tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2370727e-a46f-439c-8d49-d39c55d14edb tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:18 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2370727e-a46f-439c-8d49-d39c55d14edb tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.139481 Apr 12 10:37:18 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 53/156] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 10:37:18 2023] GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5/os-interface => generated 283 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:19 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-40992c72-b9a9-4053-bbe0-590560ccbc3e req-b04f0393-c92f-4a19-9818-815e61a00ffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47d368e-3870-49d0-8522-a94991ec4ba5", "tag": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:19 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:37:19 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=12 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:37:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-40992c72-b9a9-4053-bbe0-590560ccbc3e req-b04f0393-c92f-4a19-9818-815e61a00ffc service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-40992c72-b9a9-4053-bbe0-590560ccbc3e req-b04f0393-c92f-4a19-9818-815e61a00ffc service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-40992c72-b9a9-4053-bbe0-590560ccbc3e req-b04f0393-c92f-4a19-9818-815e61a00ffc service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-40992c72-b9a9-4053-bbe0-590560ccbc3e req-b04f0393-c92f-4a19-9818-815e61a00ffc service nova] Creating event network-changed:7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance f47d368e-3870-49d0-8522-a94991ec4ba5 on user Apr 12 10:37:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-40992c72-b9a9-4053-bbe0-590560ccbc3e req-b04f0393-c92f-4a19-9818-815e61a00ffc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034347 Apr 12 10:37:19 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 54/157] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:37:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:19 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1035500596"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:19 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:19 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d0fca5d4-94e4-46ec-9ed4-97c591d4ce1a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:19 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d0fca5d4-94e4-46ec-9ed4-97c591d4ce1a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d0fca5d4-94e4-46ec-9ed4-97c591d4ce1a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d0fca5d4-94e4-46ec-9ed4-97c591d4ce1a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d0fca5d4-94e4-46ec-9ed4-97c591d4ce1a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d0fca5d4-94e4-46ec-9ed4-97c591d4ce1a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d0fca5d4-94e4-46ec-9ed4-97c591d4ce1a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d0fca5d4-94e4-46ec-9ed4-97c591d4ce1a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d0fca5d4-94e4-46ec-9ed4-97c591d4ce1a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.492303 Apr 12 10:37:20 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 54/158] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 10:37:19 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/os-interface => generated 282 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:20 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5/action" status: 202 len: 0 microversion: 2.1 time: 0.713313 Apr 12 10:37:20 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 51/159] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:37:19 2023] POST /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5/action => generated 0 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 10:37:20 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1fae6a6a-9184-484f-bf2f-fc37131b8326 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '.version_select at 0x7fabc056bb50>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:20 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1fae6a6a-9184-484f-bf2f-fc37131b8326 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "GET /compute/v2.1/images/f4fcf2fb-8011-4377-96b3-cd19c43f5545" status: 200 len: 1611 microversion: 2.1 time: 0.052644 Apr 12 10:37:20 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 55/160] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 10:37:20 2023] GET /compute/v2.1/images/f4fcf2fb-8011-4377-96b3-cd19c43f5545 => generated 1611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:37:21 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-c5fbe625-19e4-441a-ad90-239a26a4fd91 req-ecb33133-3f15-4e37-9675-f1c2efe9fde6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c5fbe625-19e4-441a-ad90-239a26a4fd91 req-ecb33133-3f15-4e37-9675-f1c2efe9fde6 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c5fbe625-19e4-441a-ad90-239a26a4fd91 req-ecb33133-3f15-4e37-9675-f1c2efe9fde6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c5fbe625-19e4-441a-ad90-239a26a4fd91 req-ecb33133-3f15-4e37-9675-f1c2efe9fde6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-c5fbe625-19e4-441a-ad90-239a26a4fd91 req-ecb33133-3f15-4e37-9675-f1c2efe9fde6 service nova] Creating event network-changed:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:37:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-c5fbe625-19e4-441a-ad90-239a26a4fd91 req-ecb33133-3f15-4e37-9675-f1c2efe9fde6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036891 Apr 12 10:37:21 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 55/161] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:37:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:21 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-fdcbd52d-9296-4714-9ef4-d5a6a4fca3af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:21 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-fdcbd52d-9296-4714-9ef4-d5a6a4fca3af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-fdcbd52d-9296-4714-9ef4-d5a6a4fca3af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-fdcbd52d-9296-4714-9ef4-d5a6a4fca3af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-fdcbd52d-9296-4714-9ef4-d5a6a4fca3af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-fdcbd52d-9296-4714-9ef4-d5a6a4fca3af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-fdcbd52d-9296-4714-9ef4-d5a6a4fca3af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-fdcbd52d-9296-4714-9ef4-d5a6a4fca3af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:21 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-fdcbd52d-9296-4714-9ef4-d5a6a4fca3af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:37:21 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-fdcbd52d-9296-4714-9ef4-d5a6a4fca3af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1539 microversion: 2.1 time: 0.161117 Apr 12 10:37:21 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 52/162] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:37:21 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1539 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:37:21 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-6903bb8f-7bef-46da-b04a-bc7268b999c5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:21 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-6903bb8f-7bef-46da-b04a-bc7268b999c5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6903bb8f-7bef-46da-b04a-bc7268b999c5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6903bb8f-7bef-46da-b04a-bc7268b999c5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6903bb8f-7bef-46da-b04a-bc7268b999c5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6903bb8f-7bef-46da-b04a-bc7268b999c5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6903bb8f-7bef-46da-b04a-bc7268b999c5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6903bb8f-7bef-46da-b04a-bc7268b999c5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:21 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5748077b-00cd-4643-a7dd-ac9cce9bd28e tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:21 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-5748077b-00cd-4643-a7dd-ac9cce9bd28e tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5748077b-00cd-4643-a7dd-ac9cce9bd28e tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5748077b-00cd-4643-a7dd-ac9cce9bd28e tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5748077b-00cd-4643-a7dd-ac9cce9bd28e tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5748077b-00cd-4643-a7dd-ac9cce9bd28e tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5748077b-00cd-4643-a7dd-ac9cce9bd28e tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5748077b-00cd-4643-a7dd-ac9cce9bd28e tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:21 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-6903bb8f-7bef-46da-b04a-bc7268b999c5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:37:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-6903bb8f-7bef-46da-b04a-bc7268b999c5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1539 microversion: 2.1 time: 0.259403 Apr 12 10:37:21 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 56/163] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:37:21 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1539 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:37:21 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-5748077b-00cd-4643-a7dd-ac9cce9bd28e tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:37:21 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-5748077b-00cd-4643-a7dd-ac9cce9bd28e tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:37:21 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-5748077b-00cd-4643-a7dd-ac9cce9bd28e tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:37:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5748077b-00cd-4643-a7dd-ac9cce9bd28e tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f55cab4-8530-4be0-a91d-65671f0dccd9" status: 200 len: 1688 microversion: 2.87 time: 0.265449 Apr 12 10:37:21 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 56/164] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:37:21 2023] GET /compute/v2.1/servers/0f55cab4-8530-4be0-a91d-65671f0dccd9 => generated 1688 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 10:37:23 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-59410143", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "networks": [{"uuid": "092e35b9-633d-403b-a777-df3e8c018327"}]}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:23 user devstack@n-api.service[61852]: DEBUG nova.network.neutron [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] validate_networks() for [('092e35b9-633d-403b-a777-df3e8c018327', None, None, None, None, None)] {{(pid=61852) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:37:23 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Flavor limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:37:23 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Image limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:37:23 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Flavor pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:37:23 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Image pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:37:23 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:37:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:23 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Getting quotas for project 024682bfda5548b8b9b404c85dd55b34. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:37:23 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Getting quotas for user 33d19bfc4894401cb664521438338b9a and project 024682bfda5548b8b9b404c85dd55b34. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:37:23 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Going to run 1 instances... {{(pid=61852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:37:23 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:37:23 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.491394 Apr 12 10:37:23 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 53/165] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:37:23 2023] POST /compute/v2.1/servers => generated 378 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:37:23 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8b364382-8bfa-4a0f-9cf4-78a574e575b6 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:23 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-8b364382-8bfa-4a0f-9cf4-78a574e575b6 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:23 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-8b364382-8bfa-4a0f-9cf4-78a574e575b6 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d19bfc4894401cb664521438338b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024682bfda5548b8b9b404c85dd55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:37:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8b364382-8bfa-4a0f-9cf4-78a574e575b6 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/893c42b2-83ed-4823-9698-2015a3ffd4c5" status: 200 len: 1209 microversion: 2.1 time: 0.062691 Apr 12 10:37:23 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 57/166] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:37:23 2023] GET /compute/v2.1/servers/893c42b2-83ed-4823-9698-2015a3ffd4c5 => generated 1209 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:37:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-b6d5410f-145b-4527-b907-51efde165172 req-784da2e4-bae0-4c06-bb8a-3f3872cd0125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893c42b2-83ed-4823-9698-2015a3ffd4c5", "tag": "92cfa1bd-511c-4432-8b37-529eb34f8b21"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-b6d5410f-145b-4527-b907-51efde165172 req-784da2e4-bae0-4c06-bb8a-3f3872cd0125 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-b6d5410f-145b-4527-b907-51efde165172 req-784da2e4-bae0-4c06-bb8a-3f3872cd0125 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-b6d5410f-145b-4527-b907-51efde165172 req-784da2e4-bae0-4c06-bb8a-3f3872cd0125 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-b6d5410f-145b-4527-b907-51efde165172 req-784da2e4-bae0-4c06-bb8a-3f3872cd0125 service nova] Creating event network-changed:92cfa1bd-511c-4432-8b37-529eb34f8b21 for instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 on user Apr 12 10:37:27 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-b6d5410f-145b-4527-b907-51efde165172 req-784da2e4-bae0-4c06-bb8a-3f3872cd0125 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037484 Apr 12 10:37:27 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 57/167] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:37:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:27 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67a972c3-7132-4357-85f6-24196e512265"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:27 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:27 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342282 Apr 12 10:37:27 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 54/168] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:37:27 2023] POST /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:29 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-a73082d2-d78a-4478-9ec7-0b1e465ef01f req-abda702c-b994-44d6-a228-04c553b1591d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893c42b2-83ed-4823-9698-2015a3ffd4c5", "name": "network-vif-plugged", "status": "completed", "tag": "92cfa1bd-511c-4432-8b37-529eb34f8b21"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a73082d2-d78a-4478-9ec7-0b1e465ef01f req-abda702c-b994-44d6-a228-04c553b1591d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a73082d2-d78a-4478-9ec7-0b1e465ef01f req-abda702c-b994-44d6-a228-04c553b1591d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a73082d2-d78a-4478-9ec7-0b1e465ef01f req-abda702c-b994-44d6-a228-04c553b1591d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-a73082d2-d78a-4478-9ec7-0b1e465ef01f req-abda702c-b994-44d6-a228-04c553b1591d service nova] Creating event network-vif-plugged:92cfa1bd-511c-4432-8b37-529eb34f8b21 for instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 on user Apr 12 10:37:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-a73082d2-d78a-4478-9ec7-0b1e465ef01f req-abda702c-b994-44d6-a228-04c553b1591d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029359 Apr 12 10:37:29 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 58/169] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:37:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-ae2d650f-bcf6-43b2-9dac-e1e981f7b76e req-752c0c5e-8237-44b9-bd12-ced9028fe62e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893c42b2-83ed-4823-9698-2015a3ffd4c5", "name": "network-vif-plugged", "status": "completed", "tag": "92cfa1bd-511c-4432-8b37-529eb34f8b21"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ae2d650f-bcf6-43b2-9dac-e1e981f7b76e req-752c0c5e-8237-44b9-bd12-ced9028fe62e service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ae2d650f-bcf6-43b2-9dac-e1e981f7b76e req-752c0c5e-8237-44b9-bd12-ced9028fe62e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ae2d650f-bcf6-43b2-9dac-e1e981f7b76e req-752c0c5e-8237-44b9-bd12-ced9028fe62e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-ae2d650f-bcf6-43b2-9dac-e1e981f7b76e req-752c0c5e-8237-44b9-bd12-ced9028fe62e service nova] Creating event network-vif-plugged:92cfa1bd-511c-4432-8b37-529eb34f8b21 for instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 on user Apr 12 10:37:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-ae2d650f-bcf6-43b2-9dac-e1e981f7b76e req-752c0c5e-8237-44b9-bd12-ced9028fe62e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031005 Apr 12 10:37:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 58/170] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:37:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:35 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:37:35 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:37:35 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:35 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:35 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:37:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3" status: 204 len: 0 microversion: 2.1 time: 0.129095 Apr 12 10:37:35 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 55/171] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:37:35 2023] DELETE /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:37:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-852f68bd-6750-4aa3-91da-283c9f26759f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:35 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-852f68bd-6750-4aa3-91da-283c9f26759f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:35 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:37:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-852f68bd-6750-4aa3-91da-283c9f26759f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-852f68bd-6750-4aa3-91da-283c9f26759f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-852f68bd-6750-4aa3-91da-283c9f26759f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-852f68bd-6750-4aa3-91da-283c9f26759f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-852f68bd-6750-4aa3-91da-283c9f26759f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-852f68bd-6750-4aa3-91da-283c9f26759f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:35 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-852f68bd-6750-4aa3-91da-283c9f26759f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3766c8ddd6ae4fdd9d4aa6929cc080cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dbf247dab94f6eb32e7808314d420a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:37:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-852f68bd-6750-4aa3-91da-283c9f26759f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3" status: 200 len: 1542 microversion: 2.1 time: 0.180784 Apr 12 10:37:35 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 59/172] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:37:35 2023] GET /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3 => generated 1542 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:37:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-7702e647-9541-4123-8302-246290293235 req-f16c165a-f23b-41c9-8c23-a6feeccd6c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d49077-b100-4630-b4f8-00c3daffb9e3", "name": "network-vif-unplugged", "status": "completed", "tag": "74fb6084-85b5-4bc1-9933-5886e90483fd"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7702e647-9541-4123-8302-246290293235 req-f16c165a-f23b-41c9-8c23-a6feeccd6c0c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7702e647-9541-4123-8302-246290293235 req-f16c165a-f23b-41c9-8c23-a6feeccd6c0c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7702e647-9541-4123-8302-246290293235 req-f16c165a-f23b-41c9-8c23-a6feeccd6c0c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-7702e647-9541-4123-8302-246290293235 req-f16c165a-f23b-41c9-8c23-a6feeccd6c0c service nova] Creating event network-vif-unplugged:74fb6084-85b5-4bc1-9933-5886e90483fd for instance c4d49077-b100-4630-b4f8-00c3daffb9e3 on user Apr 12 10:37:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-7702e647-9541-4123-8302-246290293235 req-f16c165a-f23b-41c9-8c23-a6feeccd6c0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033750 Apr 12 10:37:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 59/173] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:37:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:36 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-50598b35-a374-41eb-889b-4793a2559f19 req-4c41fe92-1173-4212-a0f0-b315b7c4a461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d49077-b100-4630-b4f8-00c3daffb9e3", "name": "network-vif-deleted", "tag": "74fb6084-85b5-4bc1-9933-5886e90483fd"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-50598b35-a374-41eb-889b-4793a2559f19 req-4c41fe92-1173-4212-a0f0-b315b7c4a461 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-50598b35-a374-41eb-889b-4793a2559f19 req-4c41fe92-1173-4212-a0f0-b315b7c4a461 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-50598b35-a374-41eb-889b-4793a2559f19 req-4c41fe92-1173-4212-a0f0-b315b7c4a461 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:36 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-50598b35-a374-41eb-889b-4793a2559f19 req-4c41fe92-1173-4212-a0f0-b315b7c4a461 service nova] Creating event network-vif-deleted:74fb6084-85b5-4bc1-9933-5886e90483fd for instance c4d49077-b100-4630-b4f8-00c3daffb9e3 on user Apr 12 10:37:36 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-50598b35-a374-41eb-889b-4793a2559f19 req-4c41fe92-1173-4212-a0f0-b315b7c4a461 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034025 Apr 12 10:37:36 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 56/174] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:37:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:37 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-254df16b-87fa-438b-ab32-434b89c258a7 req-56c7abbc-cf83-4065-a83d-38447339fce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d49077-b100-4630-b4f8-00c3daffb9e3", "name": "network-vif-plugged", "status": "completed", "tag": "74fb6084-85b5-4bc1-9933-5886e90483fd"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-254df16b-87fa-438b-ab32-434b89c258a7 req-56c7abbc-cf83-4065-a83d-38447339fce9 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-254df16b-87fa-438b-ab32-434b89c258a7 req-56c7abbc-cf83-4065-a83d-38447339fce9 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-254df16b-87fa-438b-ab32-434b89c258a7 req-56c7abbc-cf83-4065-a83d-38447339fce9 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-254df16b-87fa-438b-ab32-434b89c258a7 req-56c7abbc-cf83-4065-a83d-38447339fce9 service nova] Creating event network-vif-plugged:74fb6084-85b5-4bc1-9933-5886e90483fd for instance c4d49077-b100-4630-b4f8-00c3daffb9e3 on user Apr 12 10:37:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-254df16b-87fa-438b-ab32-434b89c258a7 req-56c7abbc-cf83-4065-a83d-38447339fce9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040120 Apr 12 10:37:37 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 60/175] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:37:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:43 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ee69ef6b-8c63-49d0-b284-323596a58104 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:43 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-ee69ef6b-8c63-49d0-b284-323596a58104 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:43 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ee69ef6b-8c63-49d0-b284-323596a58104 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:43 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ee69ef6b-8c63-49d0-b284-323596a58104 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:43 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ee69ef6b-8c63-49d0-b284-323596a58104 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:43 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ee69ef6b-8c63-49d0-b284-323596a58104 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:43 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ee69ef6b-8c63-49d0-b284-323596a58104 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:43 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ee69ef6b-8c63-49d0-b284-323596a58104 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:43 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ee69ef6b-8c63-49d0-b284-323596a58104 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.100714 Apr 12 10:37:43 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 60/176] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 10:37:43 2023] GET /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30/os-interface => generated 282 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:44 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-81446114-183e-4bf5-8f6e-c37a8e5cd909 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:44 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-81446114-183e-4bf5-8f6e-c37a8e5cd909 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-81446114-183e-4bf5-8f6e-c37a8e5cd909 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-81446114-183e-4bf5-8f6e-c37a8e5cd909 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-81446114-183e-4bf5-8f6e-c37a8e5cd909 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-81446114-183e-4bf5-8f6e-c37a8e5cd909 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-81446114-183e-4bf5-8f6e-c37a8e5cd909 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-81446114-183e-4bf5-8f6e-c37a8e5cd909 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:44 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-81446114-183e-4bf5-8f6e-c37a8e5cd909 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.105913 Apr 12 10:37:44 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 57/177] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 10:37:44 2023] GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-interface => generated 283 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:44 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-78137417-f620-4b1e-a7fc-cfe2462e176d req-dd37d118-6a0c-44b5-9e9b-ca840ba24e45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d04cb526-f77a-457c-90b1-3e5c202c0c30", "tag": "d6cd169f-f736-45da-96ea-c0b933c882a0"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-78137417-f620-4b1e-a7fc-cfe2462e176d req-dd37d118-6a0c-44b5-9e9b-ca840ba24e45 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-78137417-f620-4b1e-a7fc-cfe2462e176d req-dd37d118-6a0c-44b5-9e9b-ca840ba24e45 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-78137417-f620-4b1e-a7fc-cfe2462e176d req-dd37d118-6a0c-44b5-9e9b-ca840ba24e45 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-78137417-f620-4b1e-a7fc-cfe2462e176d req-dd37d118-6a0c-44b5-9e9b-ca840ba24e45 service nova] Creating event network-changed:d6cd169f-f736-45da-96ea-c0b933c882a0 for instance d04cb526-f77a-457c-90b1-3e5c202c0c30 on user Apr 12 10:37:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-78137417-f620-4b1e-a7fc-cfe2462e176d req-dd37d118-6a0c-44b5-9e9b-ca840ba24e45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033808 Apr 12 10:37:44 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 61/178] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:37:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:45 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-c6618e44-df92-46e2-a79f-f07bafa79aa6 req-d292f590-2cf7-481f-872b-d5f8f8e1a490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea55f551-968e-4ece-a37a-c4128ce5e8cb", "tag": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c6618e44-df92-46e2-a79f-f07bafa79aa6 req-d292f590-2cf7-481f-872b-d5f8f8e1a490 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c6618e44-df92-46e2-a79f-f07bafa79aa6 req-d292f590-2cf7-481f-872b-d5f8f8e1a490 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c6618e44-df92-46e2-a79f-f07bafa79aa6 req-d292f590-2cf7-481f-872b-d5f8f8e1a490 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-c6618e44-df92-46e2-a79f-f07bafa79aa6 req-d292f590-2cf7-481f-872b-d5f8f8e1a490 service nova] Creating event network-changed:9d4bc0b7-4a2b-4354-a609-c673f6235cc7 for instance ea55f551-968e-4ece-a37a-c4128ce5e8cb on user Apr 12 10:37:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-c6618e44-df92-46e2-a79f-f07bafa79aa6 req-d292f590-2cf7-481f-872b-d5f8f8e1a490 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036988 Apr 12 10:37:45 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 61/179] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:37:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:45 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c1f53d0-46d5-4944-89d3-f0793ff3fbf4"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:45 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:45 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:45 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:45 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:45 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:45 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:45 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:45 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:37:45 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310963 Apr 12 10:37:45 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 58/180] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:37:45 2023] POST /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:46 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ff6497a-9926-4c83-bfd1-ea3a8ab15e98"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:46 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:46 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372447 Apr 12 10:37:46 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 62/181] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:37:46 2023] POST /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:47 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-56ca6a9f-78d4-4762-bd3b-4d8fec3c9b2a tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:47 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-56ca6a9f-78d4-4762-bd3b-4d8fec3c9b2a tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-56ca6a9f-78d4-4762-bd3b-4d8fec3c9b2a tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-56ca6a9f-78d4-4762-bd3b-4d8fec3c9b2a tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-56ca6a9f-78d4-4762-bd3b-4d8fec3c9b2a tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-56ca6a9f-78d4-4762-bd3b-4d8fec3c9b2a tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-56ca6a9f-78d4-4762-bd3b-4d8fec3c9b2a tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-56ca6a9f-78d4-4762-bd3b-4d8fec3c9b2a tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:47 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-56ca6a9f-78d4-4762-bd3b-4d8fec3c9b2a tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.130355 Apr 12 10:37:47 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 62/182] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 10:37:47 2023] GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e/os-interface => generated 282 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:48 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-b0ef9264-0a02-40ba-8c92-ebf58b69d93d req-c05062ef-700c-4800-b1bd-a07bf059c6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d261c30-0c6f-4d1b-8965-448dc019728e", "tag": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:48 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:37:48 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-b0ef9264-0a02-40ba-8c92-ebf58b69d93d req-c05062ef-700c-4800-b1bd-a07bf059c6c6 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:48 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-b0ef9264-0a02-40ba-8c92-ebf58b69d93d req-c05062ef-700c-4800-b1bd-a07bf059c6c6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:48 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-b0ef9264-0a02-40ba-8c92-ebf58b69d93d req-c05062ef-700c-4800-b1bd-a07bf059c6c6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:48 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-b0ef9264-0a02-40ba-8c92-ebf58b69d93d req-c05062ef-700c-4800-b1bd-a07bf059c6c6 service nova] Creating event network-changed:166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 for instance 3d261c30-0c6f-4d1b-8965-448dc019728e on user Apr 12 10:37:48 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-b0ef9264-0a02-40ba-8c92-ebf58b69d93d req-c05062ef-700c-4800-b1bd-a07bf059c6c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033676 Apr 12 10:37:48 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 59/183] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:37:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:49 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae71a30e-c9d5-4c42-b1c1-95c0af283832"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:49 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:49 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=19 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:37:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:49 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:37:49 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276145 Apr 12 10:37:49 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 63/184] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:37:49 2023] POST /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9fa98aaa-c6bb-445a-b665-f8dca25991ea tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:50 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9fa98aaa-c6bb-445a-b665-f8dca25991ea tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:50 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=23 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:37:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9fa98aaa-c6bb-445a-b665-f8dca25991ea tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9fa98aaa-c6bb-445a-b665-f8dca25991ea tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9fa98aaa-c6bb-445a-b665-f8dca25991ea tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9fa98aaa-c6bb-445a-b665-f8dca25991ea tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9fa98aaa-c6bb-445a-b665-f8dca25991ea tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9fa98aaa-c6bb-445a-b665-f8dca25991ea tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:50 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=33 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:37:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-9fa98aaa-c6bb-445a-b665-f8dca25991ea tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] HTTP exception thrown: Instance 270d5d4d-4df6-4ba5-9145-98f343fb3b0e could not be found. Apr 12 10:37:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9fa98aaa-c6bb-445a-b665-f8dca25991ea tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Request method failure captured: Apr 12 10:37:50 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/270d5d4d-4df6-4ba5-9145-98f343fb3b0e HTTP/1.1 Apr 12 10:37:50 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:37:50 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:37:50 user devstack@n-api.service[61854]: Connection: close Apr 12 10:37:50 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:37:50 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:37:50 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:37:50 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:37:50 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:37:50 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNolZRBzuGQIl2CwALDdozkQ253eR6H85Him0RMu336vZ9JPhVAM04m_tCHs7QclHGXNBOcZhNQPShcw4hNnZHWdCi31PrKqOqoLt8s_fYM7iym1v1fhBs5Vc2I-6fCrnMPcTR1GTBw_hmk4kJhUO8QmVJd-0nmzH8ICU--yVGT_r3mE Apr 12 10:37:50 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:37:50 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:37:50 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:37:50 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:37:50 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:37:50 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:37:50 user devstack@n-api.service[61854]: X-Project-Id: 3d8cbfbed2c843f796e810c6cc8530ba Apr 12 10:37:50 user devstack@n-api.service[61854]: X-Project-Name: tempest-VolumesNegativeTest-452512257 Apr 12 10:37:50 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:37:50 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:37:50 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3d8cbfbed2c843f796e810c6cc8530ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3d8cbfbed2c843f796e810c6cc8530ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3d8cbfbed2c843f796e810c6cc8530ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:37:50 user devstack@n-api.service[61854]: X-Tenant: tempest-VolumesNegativeTest-452512257 Apr 12 10:37:50 user devstack@n-api.service[61854]: X-Tenant-Id: 3d8cbfbed2c843f796e810c6cc8530ba Apr 12 10:37:50 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-VolumesNegativeTest-452512257 Apr 12 10:37:50 user devstack@n-api.service[61854]: X-User: tempest-VolumesNegativeTest-452512257-project-member Apr 12 10:37:50 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:37:50 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:37:50 user devstack@n-api.service[61854]: X-User-Id: 064f86e997904027aa9f086e3b137916 Apr 12 10:37:50 user devstack@n-api.service[61854]: X-User-Name: tempest-VolumesNegativeTest-452512257-project-member Apr 12 10:37:50 user devstack@n-api.service[61854]: method: > Apr 12 10:37:50 user devstack@n-api.service[61854]: exception: Instance 270d5d4d-4df6-4ba5-9145-98f343fb3b0e could not be found. Apr 12 10:37:50 user devstack@n-api.service[61854]: action_args: {'id': '270d5d4d-4df6-4ba5-9145-98f343fb3b0e'} Apr 12 10:37:50 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 270d5d4d-4df6-4ba5-9145-98f343fb3b0e could not be found. Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 270d5d4d-4df6-4ba5-9145-98f343fb3b0e could not be found. Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 270d5d4d-4df6-4ba5-9145-98f343fb3b0e could not be found. Apr 12 10:37:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:37:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9fa98aaa-c6bb-445a-b665-f8dca25991ea tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Returning 404 to user: Instance 270d5d4d-4df6-4ba5-9145-98f343fb3b0e could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:37:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9fa98aaa-c6bb-445a-b665-f8dca25991ea tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] 10.0.0.210 "GET /compute/v2.1/servers/270d5d4d-4df6-4ba5-9145-98f343fb3b0e" status: 404 len: 111 microversion: 2.1 time: 0.034022 Apr 12 10:37:50 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 63/185] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:37:50 2023] GET /compute/v2.1/servers/270d5d4d-4df6-4ba5-9145-98f343fb3b0e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:37:52 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-05b341d0-a81d-4941-a903-fd5dc6085c28 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:52 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-05b341d0-a81d-4941-a903-fd5dc6085c28 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:52 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-05b341d0-a81d-4941-a903-fd5dc6085c28 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:52 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-05b341d0-a81d-4941-a903-fd5dc6085c28 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:52 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-05b341d0-a81d-4941-a903-fd5dc6085c28 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:52 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-05b341d0-a81d-4941-a903-fd5dc6085c28 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:52 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-05b341d0-a81d-4941-a903-fd5dc6085c28 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:52 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-05b341d0-a81d-4941-a903-fd5dc6085c28 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:52 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-05b341d0-a81d-4941-a903-fd5dc6085c28 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.131907 Apr 12 10:37:52 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 60/186] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 10:37:52 2023] GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266/os-interface => generated 282 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:37:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "63298498-6bc0-47a0-b48e-815852c52771"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:52 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments/2c1f53d0-46d5-4944-89d3-f0793ff3fbf4" status: 202 len: 0 microversion: 2.1 time: 0.485734 Apr 12 10:37:52 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 64/187] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 10:37:52 2023] PUT /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments/2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:37:53 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-09801792-b5d8-470a-83a4-31af62fc046f req-33d0db4e-f5dc-4136-ab14-6583094c993d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f147b4ee-d130-41ae-a4db-bc248fb23266", "tag": "96998164-acd9-4a18-b230-d63787eaf154"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-09801792-b5d8-470a-83a4-31af62fc046f req-33d0db4e-f5dc-4136-ab14-6583094c993d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-09801792-b5d8-470a-83a4-31af62fc046f req-33d0db4e-f5dc-4136-ab14-6583094c993d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-09801792-b5d8-470a-83a4-31af62fc046f req-33d0db4e-f5dc-4136-ab14-6583094c993d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:53 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-09801792-b5d8-470a-83a4-31af62fc046f req-33d0db4e-f5dc-4136-ab14-6583094c993d service nova] Creating event network-changed:96998164-acd9-4a18-b230-d63787eaf154 for instance f147b4ee-d130-41ae-a4db-bc248fb23266 on user Apr 12 10:37:53 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-09801792-b5d8-470a-83a4-31af62fc046f req-33d0db4e-f5dc-4136-ab14-6583094c993d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037805 Apr 12 10:37:53 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 64/188] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:37:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:53 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-3d117b74-6df8-440b-b961-0d0a51daef1d tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:53 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-3d117b74-6df8-440b-b961-0d0a51daef1d tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d117b74-6df8-440b-b961-0d0a51daef1d tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d117b74-6df8-440b-b961-0d0a51daef1d tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d117b74-6df8-440b-b961-0d0a51daef1d tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d117b74-6df8-440b-b961-0d0a51daef1d tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d117b74-6df8-440b-b961-0d0a51daef1d tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d117b74-6df8-440b-b961-0d0a51daef1d tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:53 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-3d117b74-6df8-440b-b961-0d0a51daef1d tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '254d3560065c4d8a8aaf312870be2967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6981486a29b64ee7b9ef7cbf2ca852be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:37:53 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-3d117b74-6df8-440b-b961-0d0a51daef1d tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '254d3560065c4d8a8aaf312870be2967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6981486a29b64ee7b9ef7cbf2ca852be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:37:53 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-3d117b74-6df8-440b-b961-0d0a51daef1d tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '254d3560065c4d8a8aaf312870be2967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6981486a29b64ee7b9ef7cbf2ca852be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:37:53 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-3d117b74-6df8-440b-b961-0d0a51daef1d tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266" status: 200 len: 1626 microversion: 2.49 time: 0.227578 Apr 12 10:37:53 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 61/189] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:37:53 2023] GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266 => generated 1626 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:37:53 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "8eeeb207-87de-47b4-ad69-ef653e7e4ee3", "tag": "nic-tag"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:53 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:53 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-4e3ead9f-17c8-4f2b-b234-f1d8162dbd1a tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4a9ea123-e2ad-4d03-a3cf-f915764ab4e3"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:53 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-4e3ead9f-17c8-4f2b-b234-f1d8162dbd1a tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4e3ead9f-17c8-4f2b-b234-f1d8162dbd1a tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4e3ead9f-17c8-4f2b-b234-f1d8162dbd1a tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4e3ead9f-17c8-4f2b-b234-f1d8162dbd1a tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4e3ead9f-17c8-4f2b-b234-f1d8162dbd1a tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4e3ead9f-17c8-4f2b-b234-f1d8162dbd1a tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4e3ead9f-17c8-4f2b-b234-f1d8162dbd1a tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-4e3ead9f-17c8-4f2b-b234-f1d8162dbd1a tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] HTTP exception thrown: Volume 4a9ea123-e2ad-4d03-a3cf-f915764ab4e3 could not be found. Apr 12 10:37:54 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-4e3ead9f-17c8-4f2b-b234-f1d8162dbd1a tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] Request method failure captured: Apr 12 10:37:54 user devstack@n-api.service[61854]: request: PUT /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30/os-volume_attachments/8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 HTTP/1.1 Apr 12 10:37:54 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:37:54 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:37:54 user devstack@n-api.service[61854]: Connection: close Apr 12 10:37:54 user devstack@n-api.service[61854]: Content-Length: 74 Apr 12 10:37:54 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:37:54 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:37:54 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:37:54 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:37:54 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNomC8S1ZDJGMJwHs8RONxE9bqwnREhucp8kRbwJDOWUq-QDzjA7_FzPAPCCXAV2FPbX7uHXXYjNzCB_77eM64JRmk4IO-EW6_ko-oN8nl8na7KxZye5Ubgg4so08HIpp0DHcNIM-O4tKmVoeQY_iQXTqlVxkNGSeTJQyvgj4J6Fyt68 Apr 12 10:37:54 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:37:54 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:37:54 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:37:54 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:37:54 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:37:54 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:37:54 user devstack@n-api.service[61854]: X-Project-Id: 63a4674f9051465ab68de067645d78e9 Apr 12 10:37:54 user devstack@n-api.service[61854]: X-Project-Name: tempest-VolumesAdminNegativeTest-1043576201 Apr 12 10:37:54 user devstack@n-api.service[61854]: X-Role: admin,member,reader Apr 12 10:37:54 user devstack@n-api.service[61854]: X-Roles: admin,member,reader Apr 12 10:37:54 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/63a4674f9051465ab68de067645d78e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63a4674f9051465ab68de067645d78e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63a4674f9051465ab68de067645d78e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:37:54 user devstack@n-api.service[61854]: X-Tenant: tempest-VolumesAdminNegativeTest-1043576201 Apr 12 10:37:54 user devstack@n-api.service[61854]: X-Tenant-Id: 63a4674f9051465ab68de067645d78e9 Apr 12 10:37:54 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1043576201 Apr 12 10:37:54 user devstack@n-api.service[61854]: X-User: tempest-VolumesAdminNegativeTest-1043576201-project-admin Apr 12 10:37:54 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:37:54 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:37:54 user devstack@n-api.service[61854]: X-User-Id: 9da3d8a3c45b488ea1aacb2219d5bb1d Apr 12 10:37:54 user devstack@n-api.service[61854]: X-User-Name: tempest-VolumesAdminNegativeTest-1043576201-project-admin Apr 12 10:37:54 user devstack@n-api.service[61854]: Apr 12 10:37:54 user devstack@n-api.service[61854]: {"volumeAttachment": {"volumeId": "4a9ea123-e2ad-4d03-a3cf-f915764ab4e3"}} Apr 12 10:37:54 user devstack@n-api.service[61854]: method: > Apr 12 10:37:54 user devstack@n-api.service[61854]: exception: Volume 4a9ea123-e2ad-4d03-a3cf-f915764ab4e3 could not be found. Apr 12 10:37:54 user devstack@n-api.service[61854]: action_args: {'server_id': 'd04cb526-f77a-457c-90b1-3e5c202c0c30', 'id': '8ff6497a-9926-4c83-bfd1-ea3a8ab15e98', 'body': {'volumeAttachment': {'volumeId': '4a9ea123-e2ad-4d03-a3cf-f915764ab4e3'}}} Apr 12 10:37:54 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4a9ea123-e2ad-4d03-a3cf-f915764ab4e3 could not be found. (HTTP 404) (Request-ID: req-ec325adb-456d-45f4-a098-0e45f979ac96) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4a9ea123-e2ad-4d03-a3cf-f915764ab4e3 could not be found. Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 4a9ea123-e2ad-4d03-a3cf-f915764ab4e3 could not be found. Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4a9ea123-e2ad-4d03-a3cf-f915764ab4e3 could not be found. Apr 12 10:37:54 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:37:54 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-4e3ead9f-17c8-4f2b-b234-f1d8162dbd1a tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] Returning 400 to user: Volume 4a9ea123-e2ad-4d03-a3cf-f915764ab4e3 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:37:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-4e3ead9f-17c8-4f2b-b234-f1d8162dbd1a tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30/os-volume_attachments/8ff6497a-9926-4c83-bfd1-ea3a8ab15e98" status: 400 len: 107 microversion: 2.1 time: 0.209476 Apr 12 10:37:54 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 65/190] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 10:37:53 2023] PUT /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30/os-volume_attachments/8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 => generated 107 bytes in 211 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:37:54 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:54 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:54 user devstack@n-api.service[61852]: DEBUG nova.objects.instance [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lazy-loading 'services' on Instance uuid d04cb526-f77a-457c-90b1-3e5c202c0c30 {{(pid=61852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:37:54 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30/os-volume_attachments/8ff6497a-9926-4c83-bfd1-ea3a8ab15e98" status: 202 len: 0 microversion: 2.1 time: 0.266166 Apr 12 10:37:54 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 62/191] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 10:37:54 2023] DELETE /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30/os-volume_attachments/8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:37:54 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-276aff81-821a-44e4-8cca-26f28220e319 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:54 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-276aff81-821a-44e4-8cca-26f28220e319 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-276aff81-821a-44e4-8cca-26f28220e319 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-276aff81-821a-44e4-8cca-26f28220e319 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-276aff81-821a-44e4-8cca-26f28220e319 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-276aff81-821a-44e4-8cca-26f28220e319 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-276aff81-821a-44e4-8cca-26f28220e319 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-276aff81-821a-44e4-8cca-26f28220e319 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-276aff81-821a-44e4-8cca-26f28220e319 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065320 Apr 12 10:37:54 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 66/192] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:37:54 2023] GET /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:55 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-2e58e420-71d6-494e-9919-ca62d2594231 req-afe2b7b2-dcaf-4441-888e-f0f831b34914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f147b4ee-d130-41ae-a4db-bc248fb23266", "tag": "3f75b48d-25ad-47ff-ab8a-ee743607793a"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:55 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-2e58e420-71d6-494e-9919-ca62d2594231 req-afe2b7b2-dcaf-4441-888e-f0f831b34914 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:55 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-2e58e420-71d6-494e-9919-ca62d2594231 req-afe2b7b2-dcaf-4441-888e-f0f831b34914 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:55 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-2e58e420-71d6-494e-9919-ca62d2594231 req-afe2b7b2-dcaf-4441-888e-f0f831b34914 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:55 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-2e58e420-71d6-494e-9919-ca62d2594231 req-afe2b7b2-dcaf-4441-888e-f0f831b34914 service nova] Creating event network-changed:3f75b48d-25ad-47ff-ab8a-ee743607793a for instance f147b4ee-d130-41ae-a4db-bc248fb23266 on user Apr 12 10:37:55 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-2e58e420-71d6-494e-9919-ca62d2594231 req-afe2b7b2-dcaf-4441-888e-f0f831b34914 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036298 Apr 12 10:37:55 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 63/193] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:37:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:56 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-8d22cb8b-d8d3-4b2c-a2ad-8122f7a5409e req-b20355a0-01ba-4b70-9565-e1019db5fe7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f147b4ee-d130-41ae-a4db-bc248fb23266", "name": "network-vif-plugged", "status": "completed", "tag": "3f75b48d-25ad-47ff-ab8a-ee743607793a"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8d22cb8b-d8d3-4b2c-a2ad-8122f7a5409e req-b20355a0-01ba-4b70-9565-e1019db5fe7c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8d22cb8b-d8d3-4b2c-a2ad-8122f7a5409e req-b20355a0-01ba-4b70-9565-e1019db5fe7c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8d22cb8b-d8d3-4b2c-a2ad-8122f7a5409e req-b20355a0-01ba-4b70-9565-e1019db5fe7c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:56 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-8d22cb8b-d8d3-4b2c-a2ad-8122f7a5409e req-b20355a0-01ba-4b70-9565-e1019db5fe7c service nova] Creating event network-vif-plugged:3f75b48d-25ad-47ff-ab8a-ee743607793a for instance f147b4ee-d130-41ae-a4db-bc248fb23266 on user Apr 12 10:37:56 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-8d22cb8b-d8d3-4b2c-a2ad-8122f7a5409e req-b20355a0-01ba-4b70-9565-e1019db5fe7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042909 Apr 12 10:37:56 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 67/194] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:37:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:56 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266/os-interface" status: 200 len: 283 microversion: 2.49 time: 3.248031 Apr 12 10:37:56 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 65/195] 10.0.0.210 () {66 vars in 1414 bytes} [Wed Apr 12 10:37:53 2023] POST /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266/os-interface => generated 283 bytes in 3249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:37:56 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "564bff2e-deb9-45d4-aaa7-015aed7266cd", "tag": "volume-tag"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:56 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:57 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.451199 Apr 12 10:37:57 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 64/196] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 10:37:56 2023] POST /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266/os-volume_attachments => generated 194 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:37:57 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ed977ad6-4d4f-4adc-b5f0-fd74415680b7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:57 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-ed977ad6-4d4f-4adc-b5f0-fd74415680b7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ed977ad6-4d4f-4adc-b5f0-fd74415680b7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ed977ad6-4d4f-4adc-b5f0-fd74415680b7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ed977ad6-4d4f-4adc-b5f0-fd74415680b7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ed977ad6-4d4f-4adc-b5f0-fd74415680b7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ed977ad6-4d4f-4adc-b5f0-fd74415680b7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ed977ad6-4d4f-4adc-b5f0-fd74415680b7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ed977ad6-4d4f-4adc-b5f0-fd74415680b7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044036 Apr 12 10:37:57 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 68/197] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:37:57 2023] GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:37:57 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:37:57 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:37:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:57 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lazy-loading 'services' on Instance uuid 3d261c30-0c6f-4d1b-8965-448dc019728e {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:37:57 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e/os-volume_attachments/ae71a30e-c9d5-4c42-b1c1-95c0af283832" status: 202 len: 0 microversion: 2.1 time: 0.245140 Apr 12 10:37:57 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 66/198] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 10:37:57 2023] DELETE /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e/os-volume_attachments/ae71a30e-c9d5-4c42-b1c1-95c0af283832 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:37:58 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-fb796e9f-b749-4c4d-a728-12bbbde888cc req-276584b3-9bee-4a92-a32f-51340d1ec515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f147b4ee-d130-41ae-a4db-bc248fb23266", "name": "network-vif-plugged", "status": "completed", "tag": "3f75b48d-25ad-47ff-ab8a-ee743607793a"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:37:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-fb796e9f-b749-4c4d-a728-12bbbde888cc req-276584b3-9bee-4a92-a32f-51340d1ec515 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:37:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-fb796e9f-b749-4c4d-a728-12bbbde888cc req-276584b3-9bee-4a92-a32f-51340d1ec515 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:37:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-fb796e9f-b749-4c4d-a728-12bbbde888cc req-276584b3-9bee-4a92-a32f-51340d1ec515 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:37:58 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-fb796e9f-b749-4c4d-a728-12bbbde888cc req-276584b3-9bee-4a92-a32f-51340d1ec515 service nova] Creating event network-vif-plugged:3f75b48d-25ad-47ff-ab8a-ee743607793a for instance f147b4ee-d130-41ae-a4db-bc248fb23266 on user Apr 12 10:37:58 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-fb796e9f-b749-4c4d-a728-12bbbde888cc req-276584b3-9bee-4a92-a32f-51340d1ec515 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032234 Apr 12 10:37:58 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 65/199] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:37:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-687a7f32-80f8-43d1-9b87-8238c93282cb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:03 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-687a7f32-80f8-43d1-9b87-8238c93282cb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-687a7f32-80f8-43d1-9b87-8238c93282cb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-687a7f32-80f8-43d1-9b87-8238c93282cb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-687a7f32-80f8-43d1-9b87-8238c93282cb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-687a7f32-80f8-43d1-9b87-8238c93282cb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-687a7f32-80f8-43d1-9b87-8238c93282cb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-687a7f32-80f8-43d1-9b87-8238c93282cb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-687a7f32-80f8-43d1-9b87-8238c93282cb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047116 Apr 12 10:38:03 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 69/200] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:38:03 2023] GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 10:38:03 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c7f7ffe1-1dd0-4341-8454-a3e15ccaf672 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:03 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c7f7ffe1-1dd0-4341-8454-a3e15ccaf672 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7f7ffe1-1dd0-4341-8454-a3e15ccaf672 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7f7ffe1-1dd0-4341-8454-a3e15ccaf672 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7f7ffe1-1dd0-4341-8454-a3e15ccaf672 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7f7ffe1-1dd0-4341-8454-a3e15ccaf672 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7f7ffe1-1dd0-4341-8454-a3e15ccaf672 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7f7ffe1-1dd0-4341-8454-a3e15ccaf672 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:03 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c7f7ffe1-1dd0-4341-8454-a3e15ccaf672 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046106 Apr 12 10:38:03 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 67/201] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:38:03 2023] GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 12 10:38:03 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:03 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:03 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:03 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:03 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:03 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:03 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:03 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:03 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:38:03 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e" status: 204 len: 0 microversion: 2.1 time: 0.120174 Apr 12 10:38:03 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 66/202] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:38:03 2023] DELETE /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:38:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6f5248b7-4b2d-4e9a-915c-e6f66e78d1f4 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:03 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-6f5248b7-4b2d-4e9a-915c-e6f66e78d1f4 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6f5248b7-4b2d-4e9a-915c-e6f66e78d1f4 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6f5248b7-4b2d-4e9a-915c-e6f66e78d1f4 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6f5248b7-4b2d-4e9a-915c-e6f66e78d1f4 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6f5248b7-4b2d-4e9a-915c-e6f66e78d1f4 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6f5248b7-4b2d-4e9a-915c-e6f66e78d1f4 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6f5248b7-4b2d-4e9a-915c-e6f66e78d1f4 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:03 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-6f5248b7-4b2d-4e9a-915c-e6f66e78d1f4 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f1517aae734c8aa5b0acbc906af9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cede3351295e451283a0414aefea1de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-6f5248b7-4b2d-4e9a-915c-e6f66e78d1f4 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e" status: 200 len: 1671 microversion: 2.1 time: 0.185294 Apr 12 10:38:03 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 70/203] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:38:03 2023] GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e => generated 1671 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:38:04 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-0b8e00b1-2db0-4d3e-a4f1-02f71a3f5b57 req-50630167-3b78-454d-8521-d7a3afa46b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d261c30-0c6f-4d1b-8965-448dc019728e", "name": "network-vif-unplugged", "status": "completed", "tag": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0b8e00b1-2db0-4d3e-a4f1-02f71a3f5b57 req-50630167-3b78-454d-8521-d7a3afa46b82 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0b8e00b1-2db0-4d3e-a4f1-02f71a3f5b57 req-50630167-3b78-454d-8521-d7a3afa46b82 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0b8e00b1-2db0-4d3e-a4f1-02f71a3f5b57 req-50630167-3b78-454d-8521-d7a3afa46b82 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:04 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-0b8e00b1-2db0-4d3e-a4f1-02f71a3f5b57 req-50630167-3b78-454d-8521-d7a3afa46b82 service nova] Creating event network-vif-unplugged:166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 for instance 3d261c30-0c6f-4d1b-8965-448dc019728e on user Apr 12 10:38:04 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-0b8e00b1-2db0-4d3e-a4f1-02f71a3f5b57 req-50630167-3b78-454d-8521-d7a3afa46b82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034770 Apr 12 10:38:04 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 68/204] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:05 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-f90fbdaa-2ba9-4998-bfc9-135e41d4b3ae req-3433c271-39a3-4048-9b0b-95e6f7d72ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d261c30-0c6f-4d1b-8965-448dc019728e", "name": "network-vif-deleted", "tag": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-f90fbdaa-2ba9-4998-bfc9-135e41d4b3ae req-3433c271-39a3-4048-9b0b-95e6f7d72ba2 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-f90fbdaa-2ba9-4998-bfc9-135e41d4b3ae req-3433c271-39a3-4048-9b0b-95e6f7d72ba2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-f90fbdaa-2ba9-4998-bfc9-135e41d4b3ae req-3433c271-39a3-4048-9b0b-95e6f7d72ba2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:05 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-f90fbdaa-2ba9-4998-bfc9-135e41d4b3ae req-3433c271-39a3-4048-9b0b-95e6f7d72ba2 service nova] Creating event network-vif-deleted:166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 for instance 3d261c30-0c6f-4d1b-8965-448dc019728e on user Apr 12 10:38:05 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-f90fbdaa-2ba9-4998-bfc9-135e41d4b3ae req-3433c271-39a3-4048-9b0b-95e6f7d72ba2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039026 Apr 12 10:38:05 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 67/205] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-f288318e-abe3-452f-841e-311f08ef9e82 req-3f21e92c-34af-4445-ba5e-14ad9196ce41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d261c30-0c6f-4d1b-8965-448dc019728e", "name": "network-vif-plugged", "status": "completed", "tag": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f288318e-abe3-452f-841e-311f08ef9e82 req-3f21e92c-34af-4445-ba5e-14ad9196ce41 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f288318e-abe3-452f-841e-311f08ef9e82 req-3f21e92c-34af-4445-ba5e-14ad9196ce41 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f288318e-abe3-452f-841e-311f08ef9e82 req-3f21e92c-34af-4445-ba5e-14ad9196ce41 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f288318e-abe3-452f-841e-311f08ef9e82 req-3f21e92c-34af-4445-ba5e-14ad9196ce41 service nova] Creating event network-vif-plugged:166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 for instance 3d261c30-0c6f-4d1b-8965-448dc019728e on user Apr 12 10:38:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-f288318e-abe3-452f-841e-311f08ef9e82 req-3f21e92c-34af-4445-ba5e-14ad9196ce41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060799 Apr 12 10:38:06 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 71/206] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1220560850", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "networks": [{"uuid": "a5611852-639c-4e1f-8dbc-cc88bc5651d8"}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:07 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] validate_networks() for [('a5611852-639c-4e1f-8dbc-cc88bc5651d8', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:38:07 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:38:07 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:38:07 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:38:07 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:38:07 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:38:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:07 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Getting quotas for project 16de154a6d344b18a939c6a1b1a679f5. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:38:07 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Getting quotas for user 2c97c57a3e7142d088e1cf315f5d8d72 and project 16de154a6d344b18a939c6a1b1a679f5. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:38:07 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:38:07 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:38:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.547207 Apr 12 10:38:07 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 69/207] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:38:07 2023] POST /compute/v2.1/servers => generated 378 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:38:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-8d097f61-e06c-4f3d-9030-d9c6b67b8df0 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:07 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-8d097f61-e06c-4f3d-9030-d9c6b67b8df0 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:08 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-8d097f61-e06c-4f3d-9030-d9c6b67b8df0 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c97c57a3e7142d088e1cf315f5d8d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16de154a6d344b18a939c6a1b1a679f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:08 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-8d097f61-e06c-4f3d-9030-d9c6b67b8df0 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" status: 200 len: 1213 microversion: 2.1 time: 0.094448 Apr 12 10:38:08 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 68/208] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:38:07 2023] GET /compute/v2.1/servers/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:38:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:08 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:08 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lazy-loading 'services' on Instance uuid f147b4ee-d130-41ae-a4db-bc248fb23266 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:38:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266/os-volume_attachments/564bff2e-deb9-45d4-aaa7-015aed7266cd" status: 202 len: 0 microversion: 2.49 time: 0.248208 Apr 12 10:38:08 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 72/209] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 10:38:08 2023] DELETE /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266/os-volume_attachments/564bff2e-deb9-45d4-aaa7-015aed7266cd => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:38:09 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-df7fe1e4-b1c6-4f9a-ba2c-c10b96dfe024 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:09 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-df7fe1e4-b1c6-4f9a-ba2c-c10b96dfe024 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df7fe1e4-b1c6-4f9a-ba2c-c10b96dfe024 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df7fe1e4-b1c6-4f9a-ba2c-c10b96dfe024 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df7fe1e4-b1c6-4f9a-ba2c-c10b96dfe024 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df7fe1e4-b1c6-4f9a-ba2c-c10b96dfe024 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df7fe1e4-b1c6-4f9a-ba2c-c10b96dfe024 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-df7fe1e4-b1c6-4f9a-ba2c-c10b96dfe024 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-df7fe1e4-b1c6-4f9a-ba2c-c10b96dfe024 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053648 Apr 12 10:38:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 70/210] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:38:09 2023] GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:09 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-b3bcbc68-bc62-4cb7-a2dd-18ffa71e5ede tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:09 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-b3bcbc68-bc62-4cb7-a2dd-18ffa71e5ede tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b3bcbc68-bc62-4cb7-a2dd-18ffa71e5ede tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b3bcbc68-bc62-4cb7-a2dd-18ffa71e5ede tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b3bcbc68-bc62-4cb7-a2dd-18ffa71e5ede tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b3bcbc68-bc62-4cb7-a2dd-18ffa71e5ede tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b3bcbc68-bc62-4cb7-a2dd-18ffa71e5ede tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b3bcbc68-bc62-4cb7-a2dd-18ffa71e5ede tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:09 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-b3bcbc68-bc62-4cb7-a2dd-18ffa71e5ede tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053440 Apr 12 10:38:09 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 69/211] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:38:09 2023] GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:09 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-41aef6a0-8a97-4973-a890-950722af6f7a tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:09 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-41aef6a0-8a97-4973-a890-950722af6f7a tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:09 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2c1f53d0-46d5-4944-89d3-f0793ff3fbf4"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:09 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-41aef6a0-8a97-4973-a890-950722af6f7a tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-41aef6a0-8a97-4973-a890-950722af6f7a tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-41aef6a0-8a97-4973-a890-950722af6f7a tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-41aef6a0-8a97-4973-a890-950722af6f7a tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-41aef6a0-8a97-4973-a890-950722af6f7a tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-41aef6a0-8a97-4973-a890-950722af6f7a tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:09 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-41aef6a0-8a97-4973-a890-950722af6f7a tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.150527 Apr 12 10:38:09 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 73/212] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 10:38:09 2023] GET /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3/os-interface => generated 1828 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:38:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments/63298498-6bc0-47a0-b48e-815852c52771" status: 202 len: 0 microversion: 2.1 time: 0.334850 Apr 12 10:38:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 71/213] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 10:38:09 2023] PUT /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments/63298498-6bc0-47a0-b48e-815852c52771 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-c3ad85f9-36d9-46be-a477-81ead2fceeec req-c4b9ef76-1b39-4d60-8980-bdf0b1fa595c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "tag": "fe31a29c-b57d-463d-98ba-6527848edeba"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-c3ad85f9-36d9-46be-a477-81ead2fceeec req-c4b9ef76-1b39-4d60-8980-bdf0b1fa595c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-c3ad85f9-36d9-46be-a477-81ead2fceeec req-c4b9ef76-1b39-4d60-8980-bdf0b1fa595c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-c3ad85f9-36d9-46be-a477-81ead2fceeec req-c4b9ef76-1b39-4d60-8980-bdf0b1fa595c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:10 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-c3ad85f9-36d9-46be-a477-81ead2fceeec req-c4b9ef76-1b39-4d60-8980-bdf0b1fa595c service nova] Creating event network-changed:fe31a29c-b57d-463d-98ba-6527848edeba for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:10 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-c3ad85f9-36d9-46be-a477-81ead2fceeec req-c4b9ef76-1b39-4d60-8980-bdf0b1fa595c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034853 Apr 12 10:38:10 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 70/214] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-234c0bfd-d5b5-4b52-8116-1dc6c1b37e74 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-234c0bfd-d5b5-4b52-8116-1dc6c1b37e74 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-234c0bfd-d5b5-4b52-8116-1dc6c1b37e74 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-234c0bfd-d5b5-4b52-8116-1dc6c1b37e74 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-234c0bfd-d5b5-4b52-8116-1dc6c1b37e74 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-234c0bfd-d5b5-4b52-8116-1dc6c1b37e74 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-234c0bfd-d5b5-4b52-8116-1dc6c1b37e74 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-234c0bfd-d5b5-4b52-8116-1dc6c1b37e74 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:10 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f5df8541-38f5-420b-a5c1-3be916573c93 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '.version_select at 0x7fabbfa2c670>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:10 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f5df8541-38f5-420b-a5c1-3be916573c93 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "GET /compute/v2.1/images/f4fcf2fb-8011-4377-96b3-cd19c43f5545" status: 200 len: 1725 microversion: 2.1 time: 0.061522 Apr 12 10:38:10 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 72/215] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 10:38:10 2023] GET /compute/v2.1/images/f4fcf2fb-8011-4377-96b3-cd19c43f5545 => generated 1725 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-4e233a4c-3d91-44bb-a7de-589291842664 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '.version_select at 0x7fabbfa05510>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:10 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-4e233a4c-3d91-44bb-a7de-589291842664 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "GET /compute/v2.1/images/f4fcf2fb-8011-4377-96b3-cd19c43f5545" status: 200 len: 1725 microversion: 2.1 time: 0.053943 Apr 12 10:38:10 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 71/216] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 10:38:10 2023] GET /compute/v2.1/images/f4fcf2fb-8011-4377-96b3-cd19c43f5545 => generated 1725 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:38:10 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e2fc7b7b-f32a-4225-9de0-2bc50aec6583 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:10 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-e2fc7b7b-f32a-4225-9de0-2bc50aec6583 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e2fc7b7b-f32a-4225-9de0-2bc50aec6583 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e2fc7b7b-f32a-4225-9de0-2bc50aec6583 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e2fc7b7b-f32a-4225-9de0-2bc50aec6583 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e2fc7b7b-f32a-4225-9de0-2bc50aec6583 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e2fc7b7b-f32a-4225-9de0-2bc50aec6583 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e2fc7b7b-f32a-4225-9de0-2bc50aec6583 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-234c0bfd-d5b5-4b52-8116-1dc6c1b37e74 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949ebef2d45b4d64a89a11d837dfffd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcfbd94249342b2a436d2592e0dc9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-234c0bfd-d5b5-4b52-8116-1dc6c1b37e74 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '949ebef2d45b4d64a89a11d837dfffd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcfbd94249342b2a436d2592e0dc9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-234c0bfd-d5b5-4b52-8116-1dc6c1b37e74 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '949ebef2d45b4d64a89a11d837dfffd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcfbd94249342b2a436d2592e0dc9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-234c0bfd-d5b5-4b52-8116-1dc6c1b37e74 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3" status: 200 len: 2820 microversion: 2.42 time: 0.217166 Apr 12 10:38:10 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 74/217] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:38:10 2023] GET /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3 => generated 2820 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-9b879cf4-c87a-46b9-89ae-aab64a3cdd28 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-9b879cf4-c87a-46b9-89ae-aab64a3cdd28 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9b879cf4-c87a-46b9-89ae-aab64a3cdd28 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9b879cf4-c87a-46b9-89ae-aab64a3cdd28 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9b879cf4-c87a-46b9-89ae-aab64a3cdd28 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9b879cf4-c87a-46b9-89ae-aab64a3cdd28 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9b879cf4-c87a-46b9-89ae-aab64a3cdd28 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9b879cf4-c87a-46b9-89ae-aab64a3cdd28 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-043d8c22-b5de-4f42-a22b-b3d6d79070a4 req-c9d4377a-51b8-4ff7-8b00-b48255c39ddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2", "tag": "5eed0079-0c02-43b0-8124-4ef257a7eb1f"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-043d8c22-b5de-4f42-a22b-b3d6d79070a4 req-c9d4377a-51b8-4ff7-8b00-b48255c39ddf service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-043d8c22-b5de-4f42-a22b-b3d6d79070a4 req-c9d4377a-51b8-4ff7-8b00-b48255c39ddf service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-043d8c22-b5de-4f42-a22b-b3d6d79070a4 req-c9d4377a-51b8-4ff7-8b00-b48255c39ddf service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-043d8c22-b5de-4f42-a22b-b3d6d79070a4 req-c9d4377a-51b8-4ff7-8b00-b48255c39ddf service nova] Creating event network-changed:5eed0079-0c02-43b0-8124-4ef257a7eb1f for instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 on user Apr 12 10:38:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-043d8c22-b5de-4f42-a22b-b3d6d79070a4 req-c9d4377a-51b8-4ff7-8b00-b48255c39ddf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031146 Apr 12 10:38:10 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 75/218] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:10 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-9b879cf4-c87a-46b9-89ae-aab64a3cdd28 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.160259 Apr 12 10:38:10 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 72/219] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 10:38:10 2023] GET /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3/os-interface => generated 1828 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:10 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-e2fc7b7b-f32a-4225-9de0-2bc50aec6583 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c757f04065b9488ba75739e59d7be377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce2a3bde13e464f8df0a41f30c240ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:10 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-e2fc7b7b-f32a-4225-9de0-2bc50aec6583 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5" status: 200 len: 1671 microversion: 2.1 time: 0.286454 Apr 12 10:38:10 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 73/220] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:38:10 2023] GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5 => generated 1671 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:38:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266/os-interface/3f75b48d-25ad-47ff-ab8a-ee743607793a" status: 202 len: 0 microversion: 2.49 time: 0.057605 Apr 12 10:38:10 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 76/221] 10.0.0.210 () {64 vars in 1507 bytes} [Wed Apr 12 10:38:10 2023] DELETE /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266/os-interface/3f75b48d-25ad-47ff-ab8a-ee743607793a => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-10b4756c-5194-486d-8c44-3629e0bbea0c tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-10b4756c-5194-486d-8c44-3629e0bbea0c tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-10b4756c-5194-486d-8c44-3629e0bbea0c tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-10b4756c-5194-486d-8c44-3629e0bbea0c tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-10b4756c-5194-486d-8c44-3629e0bbea0c tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-10b4756c-5194-486d-8c44-3629e0bbea0c tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-10b4756c-5194-486d-8c44-3629e0bbea0c tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-10b4756c-5194-486d-8c44-3629e0bbea0c tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:11 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-10b4756c-5194-486d-8c44-3629e0bbea0c tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266/os-instance-actions/req-03634afc-4aee-4999-bf7e-4f554c0cfb2a" status: 200 len: 474 microversion: 2.49 time: 0.278666 Apr 12 10:38:11 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 73/222] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 10:38:10 2023] GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266/os-instance-actions/req-03634afc-4aee-4999-bf7e-4f554c0cfb2a => generated 474 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:38:11 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:11 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:11 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:38:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f147b4ee-d130-41ae-a4db-bc248fb23266", "name": "network-vif-deleted", "tag": "3f75b48d-25ad-47ff-ab8a-ee743607793a"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] Creating event network-vif-deleted:3f75b48d-25ad-47ff-ab8a-ee743607793a for instance f147b4ee-d130-41ae-a4db-bc248fb23266 on user Apr 12 10:38:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039124 Apr 12 10:38:11 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 77/223] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:11 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3" status: 204 len: 0 microversion: 2.42 time: 0.188044 Apr 12 10:38:11 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 74/224] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 10:38:11 2023] DELETE /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 10:38:11 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-ad764d2f-4a3a-4bb3-ad5a-1b2fe10987ab tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:11 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-ad764d2f-4a3a-4bb3-ad5a-1b2fe10987ab tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ad764d2f-4a3a-4bb3-ad5a-1b2fe10987ab tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ad764d2f-4a3a-4bb3-ad5a-1b2fe10987ab tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ad764d2f-4a3a-4bb3-ad5a-1b2fe10987ab tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ad764d2f-4a3a-4bb3-ad5a-1b2fe10987ab tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ad764d2f-4a3a-4bb3-ad5a-1b2fe10987ab tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ad764d2f-4a3a-4bb3-ad5a-1b2fe10987ab tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-87d7a52b-58d8-461c-8abb-94dba3374257 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:11 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-87d7a52b-58d8-461c-8abb-94dba3374257 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-87d7a52b-58d8-461c-8abb-94dba3374257 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-87d7a52b-58d8-461c-8abb-94dba3374257 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-87d7a52b-58d8-461c-8abb-94dba3374257 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-87d7a52b-58d8-461c-8abb-94dba3374257 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-87d7a52b-58d8-461c-8abb-94dba3374257 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-87d7a52b-58d8-461c-8abb-94dba3374257 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:12 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-87d7a52b-58d8-461c-8abb-94dba3374257 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-87d7a52b-58d8-461c-8abb-94dba3374257 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1658 microversion: 2.1 time: 0.209253 Apr 12 10:38:12 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 78/225] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:38:11 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1658 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:38:12 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7b40fa2f-bd32-433c-9c76-868882845db2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:12 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-ad764d2f-4a3a-4bb3-ad5a-1b2fe10987ab tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949ebef2d45b4d64a89a11d837dfffd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcfbd94249342b2a436d2592e0dc9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:12 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-7b40fa2f-bd32-433c-9c76-868882845db2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:12 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-ad764d2f-4a3a-4bb3-ad5a-1b2fe10987ab tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '949ebef2d45b4d64a89a11d837dfffd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcfbd94249342b2a436d2592e0dc9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:12 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-ad764d2f-4a3a-4bb3-ad5a-1b2fe10987ab tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '949ebef2d45b4d64a89a11d837dfffd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcfbd94249342b2a436d2592e0dc9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:12 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-ad764d2f-4a3a-4bb3-ad5a-1b2fe10987ab tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3" status: 200 len: 2945 microversion: 2.42 time: 0.273389 Apr 12 10:38:12 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 74/226] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:38:11 2023] GET /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3 => generated 2945 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:38:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7b40fa2f-bd32-433c-9c76-868882845db2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7b40fa2f-bd32-433c-9c76-868882845db2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7b40fa2f-bd32-433c-9c76-868882845db2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7b40fa2f-bd32-433c-9c76-868882845db2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7b40fa2f-bd32-433c-9c76-868882845db2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7b40fa2f-bd32-433c-9c76-868882845db2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:12 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f147b4ee-d130-41ae-a4db-bc248fb23266", "name": "network-vif-unplugged", "status": "completed", "tag": "3f75b48d-25ad-47ff-ab8a-ee743607793a"}, {"server_uuid": "f147b4ee-d130-41ae-a4db-bc248fb23266", "name": "network-vif-plugged", "status": "completed", "tag": "3f75b48d-25ad-47ff-ab8a-ee743607793a"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] Creating event network-vif-unplugged:3f75b48d-25ad-47ff-ab8a-ee743607793a for instance f147b4ee-d130-41ae-a4db-bc248fb23266 on user Apr 12 10:38:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] Creating event network-vif-plugged:3f75b48d-25ad-47ff-ab8a-ee743607793a for instance f147b4ee-d130-41ae-a4db-bc248fb23266 on user Apr 12 10:38:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033511 Apr 12 10:38:12 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 79/227] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:12 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:12 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-7b40fa2f-bd32-433c-9c76-868882845db2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:12 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-7b40fa2f-bd32-433c-9c76-868882845db2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1658 microversion: 2.1 time: 0.304769 Apr 12 10:38:12 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 75/228] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:38:12 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1658 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:38:12 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-unplugged", "status": "completed", "tag": "fe31a29c-b57d-463d-98ba-6527848edeba"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "fe31a29c-b57d-463d-98ba-6527848edeba"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:12 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:12 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:12 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:12 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] Creating event network-vif-unplugged:fe31a29c-b57d-463d-98ba-6527848edeba for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:12 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] Creating event network-vif-plugged:fe31a29c-b57d-463d-98ba-6527848edeba for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:12 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.037961 Apr 12 10:38:12 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 75/229] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:12 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:38:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-unplugged", "status": "completed", "tag": "1173b214-caa3-4d2b-9ee4-efe4ab063cac"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "1173b214-caa3-4d2b-9ee4-efe4ab063cac"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-unplugged", "status": "completed", "tag": "925f7823-924b-4df5-8bec-5f065331e4fe"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "925f7823-924b-4df5-8bec-5f065331e4fe"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-unplugged", "status": "completed", "tag": "23c5dfaa-4003-410d-836e-4218b879cf66"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "23c5dfaa-4003-410d-836e-4218b879cf66"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Creating event network-vif-unplugged:1173b214-caa3-4d2b-9ee4-efe4ab063cac for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Creating event network-vif-plugged:1173b214-caa3-4d2b-9ee4-efe4ab063cac for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Creating event network-vif-unplugged:925f7823-924b-4df5-8bec-5f065331e4fe for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Creating event network-vif-plugged:925f7823-924b-4df5-8bec-5f065331e4fe for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Creating event network-vif-unplugged:23c5dfaa-4003-410d-836e-4218b879cf66 for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Creating event network-vif-plugged:23c5dfaa-4003-410d-836e-4218b879cf66 for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1044 microversion: 2.1 time: 0.039136 Apr 12 10:38:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 80/230] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:13 2023] POST /compute/v2.1/os-server-external-events => generated 1044 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:38:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7b1dfc94-110c-4433-b2e9-9e126c81d881 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:14 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-7b1dfc94-110c-4433-b2e9-9e126c81d881 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7b1dfc94-110c-4433-b2e9-9e126c81d881 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7b1dfc94-110c-4433-b2e9-9e126c81d881 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7b1dfc94-110c-4433-b2e9-9e126c81d881 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7b1dfc94-110c-4433-b2e9-9e126c81d881 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7b1dfc94-110c-4433-b2e9-9e126c81d881 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7b1dfc94-110c-4433-b2e9-9e126c81d881 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:14 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:14 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-7b1dfc94-110c-4433-b2e9-9e126c81d881 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d19bfc4894401cb664521438338b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024682bfda5548b8b9b404c85dd55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-7b1dfc94-110c-4433-b2e9-9e126c81d881 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/893c42b2-83ed-4823-9698-2015a3ffd4c5" status: 200 len: 1491 microversion: 2.1 time: 0.208388 Apr 12 10:38:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 76/231] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:38:14 2023] GET /compute/v2.1/servers/893c42b2-83ed-4823-9698-2015a3ffd4c5 => generated 1491 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:38:14 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-unplugged", "status": "completed", "tag": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-unplugged", "status": "completed", "tag": "307fee9a-af5f-45a9-b678-7cb16cfad99d"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "307fee9a-af5f-45a9-b678-7cb16cfad99d"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Creating event network-vif-unplugged:c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Creating event network-vif-plugged:c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Creating event network-vif-unplugged:307fee9a-af5f-45a9-b678-7cb16cfad99d for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Creating event network-vif-plugged:307fee9a-af5f-45a9-b678-7cb16cfad99d for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.042061 Apr 12 10:38:14 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 76/232] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:14 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:14 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2", "name": "network-vif-plugged", "status": "completed", "tag": "5eed0079-0c02-43b0-8124-4ef257a7eb1f"}, {"server_uuid": "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2", "name": "network-vif-plugged", "status": "completed", "tag": "5eed0079-0c02-43b0-8124-4ef257a7eb1f"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] Creating event network-vif-plugged:5eed0079-0c02-43b0-8124-4ef257a7eb1f for instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 on user Apr 12 10:38:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] Creating event network-vif-plugged:5eed0079-0c02-43b0-8124-4ef257a7eb1f for instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 on user Apr 12 10:38:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032244 Apr 12 10:38:14 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 81/233] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:15 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-unplugged", "status": "completed", "tag": "718755e4-0ae2-47c0-b5c9-630c5df1e840"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-plugged", "status": "completed", "tag": "718755e4-0ae2-47c0-b5c9-630c5df1e840"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] Creating event network-vif-unplugged:718755e4-0ae2-47c0-b5c9-630c5df1e840 for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] Creating event network-vif-plugged:718755e4-0ae2-47c0-b5c9-630c5df1e840 for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.043324 Apr 12 10:38:15 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 77/234] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:15 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:17 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-ff6ff546-89a0-4fb1-b93f-65aadba18a1e req-d91eda41-9f5c-48c5-94d1-7eb34f199453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-deleted", "tag": "1173b214-caa3-4d2b-9ee4-efe4ab063cac"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-ff6ff546-89a0-4fb1-b93f-65aadba18a1e req-d91eda41-9f5c-48c5-94d1-7eb34f199453 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-ff6ff546-89a0-4fb1-b93f-65aadba18a1e req-d91eda41-9f5c-48c5-94d1-7eb34f199453 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-ff6ff546-89a0-4fb1-b93f-65aadba18a1e req-d91eda41-9f5c-48c5-94d1-7eb34f199453 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:17 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:17 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-ff6ff546-89a0-4fb1-b93f-65aadba18a1e req-d91eda41-9f5c-48c5-94d1-7eb34f199453 service nova] Creating event network-vif-deleted:1173b214-caa3-4d2b-9ee4-efe4ab063cac for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:18 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-ff6ff546-89a0-4fb1-b93f-65aadba18a1e req-d91eda41-9f5c-48c5-94d1-7eb34f199453 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057961 Apr 12 10:38:18 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 77/235] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:20 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-9c90eacd-0d32-42e4-9f89-8d92dc85f9eb req-23183a6e-7a72-4e4a-b471-96fe0e441fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-deleted", "tag": "fe31a29c-b57d-463d-98ba-6527848edeba"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-deleted", "tag": "925f7823-924b-4df5-8bec-5f065331e4fe"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-deleted", "tag": "23c5dfaa-4003-410d-836e-4218b879cf66"}, {"server_uuid": "b9fd76e3-c7ed-4631-b056-3bd13439f7d3", "name": "network-vif-deleted", "tag": "718755e4-0ae2-47c0-b5c9-630c5df1e840"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9c90eacd-0d32-42e4-9f89-8d92dc85f9eb req-23183a6e-7a72-4e4a-b471-96fe0e441fc4 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9c90eacd-0d32-42e4-9f89-8d92dc85f9eb req-23183a6e-7a72-4e4a-b471-96fe0e441fc4 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9c90eacd-0d32-42e4-9f89-8d92dc85f9eb req-23183a6e-7a72-4e4a-b471-96fe0e441fc4 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-9c90eacd-0d32-42e4-9f89-8d92dc85f9eb req-23183a6e-7a72-4e4a-b471-96fe0e441fc4 service nova] Creating event network-vif-deleted:fe31a29c-b57d-463d-98ba-6527848edeba for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-9c90eacd-0d32-42e4-9f89-8d92dc85f9eb req-23183a6e-7a72-4e4a-b471-96fe0e441fc4 service nova] Creating event network-vif-deleted:925f7823-924b-4df5-8bec-5f065331e4fe for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-9c90eacd-0d32-42e4-9f89-8d92dc85f9eb req-23183a6e-7a72-4e4a-b471-96fe0e441fc4 service nova] Creating event network-vif-deleted:23c5dfaa-4003-410d-836e-4218b879cf66 for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-9c90eacd-0d32-42e4-9f89-8d92dc85f9eb req-23183a6e-7a72-4e4a-b471-96fe0e441fc4 service nova] Creating event network-vif-deleted:718755e4-0ae2-47c0-b5c9-630c5df1e840 for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 on user Apr 12 10:38:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-9c90eacd-0d32-42e4-9f89-8d92dc85f9eb req-23183a6e-7a72-4e4a-b471-96fe0e441fc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.044883 Apr 12 10:38:20 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 82/236] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:20 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1497116859", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e"}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] validate_networks() for [('49a2fb41-5e5e-4d4b-969a-0043778b4b0e', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:22 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:22 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-e9342acf-aaf3-4b17-98a0-d9b1a9d7666a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:22 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-e9342acf-aaf3-4b17-98a0-d9b1a9d7666a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:22 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Getting quotas for project 3789b59ccc704f86afac83af21fd84f9. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Getting quotas for user ba49b947c74e48f3b161b6f9fce8b1c5 and project 3789b59ccc704f86afac83af21fd84f9. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:38:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e9342acf-aaf3-4b17-98a0-d9b1a9d7666a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e9342acf-aaf3-4b17-98a0-d9b1a9d7666a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e9342acf-aaf3-4b17-98a0-d9b1a9d7666a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e9342acf-aaf3-4b17-98a0-d9b1a9d7666a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e9342acf-aaf3-4b17-98a0-d9b1a9d7666a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e9342acf-aaf3-4b17-98a0-d9b1a9d7666a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:38:22 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-e9342acf-aaf3-4b17-98a0-d9b1a9d7666a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062642 Apr 12 10:38:22 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 78/237] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:38:22 2023] GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b8ef019e-c183-4854-9e0d-219c92e5e51a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:22 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-b8ef019e-c183-4854-9e0d-219c92e5e51a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:22 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=40 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.688345 Apr 12 10:38:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b8ef019e-c183-4854-9e0d-219c92e5e51a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b8ef019e-c183-4854-9e0d-219c92e5e51a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:22 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 78/238] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 10:38:22 2023] POST /compute/v2.1/servers => generated 378 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 10:38:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b8ef019e-c183-4854-9e0d-219c92e5e51a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b8ef019e-c183-4854-9e0d-219c92e5e51a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b8ef019e-c183-4854-9e0d-219c92e5e51a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b8ef019e-c183-4854-9e0d-219c92e5e51a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:22 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-91336474-0df6-475d-b613-3be171a62cbd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:22 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-91336474-0df6-475d-b613-3be171a62cbd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b8ef019e-c183-4854-9e0d-219c92e5e51a tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048591 Apr 12 10:38:22 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 83/239] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:38:22 2023] GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:22 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-91336474-0df6-475d-b613-3be171a62cbd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:22 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-91336474-0df6-475d-b613-3be171a62cbd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:22 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-91336474-0df6-475d-b613-3be171a62cbd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:22 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-91336474-0df6-475d-b613-3be171a62cbd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" status: 200 len: 1395 microversion: 2.87 time: 0.131902 Apr 12 10:38:22 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 79/240] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:38:22 2023] GET /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 => generated 1395 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 10:38:23 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lazy-loading 'services' on Instance uuid ea55f551-968e-4ece-a37a-c4128ce5e8cb {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:38:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments/2c1f53d0-46d5-4944-89d3-f0793ff3fbf4" status: 202 len: 0 microversion: 2.1 time: 0.222882 Apr 12 10:38:23 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 79/241] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 10:38:22 2023] DELETE /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments/2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:38:23 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0fba9441-d465-42ec-b01c-bd06eaef52af tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:23 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-0fba9441-d465-42ec-b01c-bd06eaef52af tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0fba9441-d465-42ec-b01c-bd06eaef52af tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0fba9441-d465-42ec-b01c-bd06eaef52af tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0fba9441-d465-42ec-b01c-bd06eaef52af tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0fba9441-d465-42ec-b01c-bd06eaef52af tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0fba9441-d465-42ec-b01c-bd06eaef52af tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0fba9441-d465-42ec-b01c-bd06eaef52af tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:23 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-0fba9441-d465-42ec-b01c-bd06eaef52af tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070537 Apr 12 10:38:23 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 84/242] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:38:23 2023] GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:25 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-049d61af-5553-435f-ba37-7c7c96db346f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:25 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-049d61af-5553-435f-ba37-7c7c96db346f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-049d61af-5553-435f-ba37-7c7c96db346f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-049d61af-5553-435f-ba37-7c7c96db346f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-049d61af-5553-435f-ba37-7c7c96db346f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-049d61af-5553-435f-ba37-7c7c96db346f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-049d61af-5553-435f-ba37-7c7c96db346f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-049d61af-5553-435f-ba37-7c7c96db346f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-049d61af-5553-435f-ba37-7c7c96db346f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] HTTP exception thrown: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:25 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-049d61af-5553-435f-ba37-7c7c96db346f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Request method failure captured: Apr 12 10:38:25 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3 HTTP/1.1 Apr 12 10:38:25 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:38:25 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:38:25 user devstack@n-api.service[61852]: Connection: close Apr 12 10:38:25 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:38:25 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:38:25 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:38:25 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:38:25 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:38:25 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNol0WZCPr_v2iLXoikPTlSDtACQlck11lM4H3lkpmOGdNWHddbm4awov03rWzP4Ysb0q7nR5KihxSQt7MsCCGPckJx8TLjXllCXUXqSpvSs3lyXpD1JOLDFacl6dmShBMfTVnclMIDLFzzwmHXYi8X_KrFMkTvjueMv2KC6jOaWhXv0 Apr 12 10:38:25 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:38:25 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:38:25 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:38:25 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:38:25 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:38:25 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:38:25 user devstack@n-api.service[61852]: X-Project-Id: d3dbf247dab94f6eb32e7808314d420a Apr 12 10:38:25 user devstack@n-api.service[61852]: X-Project-Name: tempest-DeleteServersTestJSON-1147850030 Apr 12 10:38:25 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:38:25 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:38:25 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d3dbf247dab94f6eb32e7808314d420a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d3dbf247dab94f6eb32e7808314d420a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d3dbf247dab94f6eb32e7808314d420a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:38:25 user devstack@n-api.service[61852]: X-Tenant: tempest-DeleteServersTestJSON-1147850030 Apr 12 10:38:25 user devstack@n-api.service[61852]: X-Tenant-Id: d3dbf247dab94f6eb32e7808314d420a Apr 12 10:38:25 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-DeleteServersTestJSON-1147850030 Apr 12 10:38:25 user devstack@n-api.service[61852]: X-User: tempest-DeleteServersTestJSON-1147850030-project-member Apr 12 10:38:25 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:38:25 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:38:25 user devstack@n-api.service[61852]: X-User-Id: 3766c8ddd6ae4fdd9d4aa6929cc080cf Apr 12 10:38:25 user devstack@n-api.service[61852]: X-User-Name: tempest-DeleteServersTestJSON-1147850030-project-member Apr 12 10:38:25 user devstack@n-api.service[61852]: method: > Apr 12 10:38:25 user devstack@n-api.service[61852]: exception: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:25 user devstack@n-api.service[61852]: action_args: {'id': 'c4d49077-b100-4630-b4f8-00c3daffb9e3'} Apr 12 10:38:25 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:25 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-049d61af-5553-435f-ba37-7c7c96db346f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Returning 404 to user: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:38:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-049d61af-5553-435f-ba37-7c7c96db346f tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3" status: 404 len: 111 microversion: 2.1 time: 0.061983 Apr 12 10:38:25 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 80/243] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:38:25 2023] GET /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:38:25 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d969500d-e01d-48bc-a6ea-37f823151511 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:25 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d969500d-e01d-48bc-a6ea-37f823151511 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d969500d-e01d-48bc-a6ea-37f823151511 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d969500d-e01d-48bc-a6ea-37f823151511 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d969500d-e01d-48bc-a6ea-37f823151511 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d969500d-e01d-48bc-a6ea-37f823151511 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d969500d-e01d-48bc-a6ea-37f823151511 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d969500d-e01d-48bc-a6ea-37f823151511 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:25 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-d969500d-e01d-48bc-a6ea-37f823151511 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] HTTP exception thrown: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:25 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d969500d-e01d-48bc-a6ea-37f823151511 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Request method failure captured: Apr 12 10:38:25 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3/os-volume_attachments HTTP/1.1 Apr 12 10:38:25 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:38:25 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:38:25 user devstack@n-api.service[61853]: Connection: close Apr 12 10:38:25 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:38:25 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:38:25 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:38:25 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:38:25 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:38:25 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNol0WZCPr_v2iLXoikPTlSDtACQlck11lM4H3lkpmOGdNWHddbm4awov03rWzP4Ysb0q7nR5KihxSQt7MsCCGPckJx8TLjXllCXUXqSpvSs3lyXpD1JOLDFacl6dmShBMfTVnclMIDLFzzwmHXYi8X_KrFMkTvjueMv2KC6jOaWhXv0 Apr 12 10:38:25 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:38:25 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:38:25 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:38:25 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:38:25 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:38:25 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:38:25 user devstack@n-api.service[61853]: X-Project-Id: d3dbf247dab94f6eb32e7808314d420a Apr 12 10:38:25 user devstack@n-api.service[61853]: X-Project-Name: tempest-DeleteServersTestJSON-1147850030 Apr 12 10:38:25 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:38:25 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:38:25 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d3dbf247dab94f6eb32e7808314d420a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d3dbf247dab94f6eb32e7808314d420a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d3dbf247dab94f6eb32e7808314d420a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:38:25 user devstack@n-api.service[61853]: X-Tenant: tempest-DeleteServersTestJSON-1147850030 Apr 12 10:38:25 user devstack@n-api.service[61853]: X-Tenant-Id: d3dbf247dab94f6eb32e7808314d420a Apr 12 10:38:25 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-DeleteServersTestJSON-1147850030 Apr 12 10:38:25 user devstack@n-api.service[61853]: X-User: tempest-DeleteServersTestJSON-1147850030-project-member Apr 12 10:38:25 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:38:25 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:38:25 user devstack@n-api.service[61853]: X-User-Id: 3766c8ddd6ae4fdd9d4aa6929cc080cf Apr 12 10:38:25 user devstack@n-api.service[61853]: X-User-Name: tempest-DeleteServersTestJSON-1147850030-project-member Apr 12 10:38:25 user devstack@n-api.service[61853]: method: > Apr 12 10:38:25 user devstack@n-api.service[61853]: exception: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:25 user devstack@n-api.service[61853]: action_args: {'server_id': 'c4d49077-b100-4630-b4f8-00c3daffb9e3'} Apr 12 10:38:25 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:25 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:38:25 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d969500d-e01d-48bc-a6ea-37f823151511 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Returning 404 to user: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:38:25 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-d969500d-e01d-48bc-a6ea-37f823151511 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.053426 Apr 12 10:38:25 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 80/244] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:38:25 2023] GET /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3/os-volume_attachments => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:38:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-187760c8-4421-4610-b026-b1f90f7ffbb4 req-5014965f-9ef6-4da2-a68e-7255c5adbab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212", "tag": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-187760c8-4421-4610-b026-b1f90f7ffbb4 req-5014965f-9ef6-4da2-a68e-7255c5adbab1 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-187760c8-4421-4610-b026-b1f90f7ffbb4 req-5014965f-9ef6-4da2-a68e-7255c5adbab1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-187760c8-4421-4610-b026-b1f90f7ffbb4 req-5014965f-9ef6-4da2-a68e-7255c5adbab1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-187760c8-4421-4610-b026-b1f90f7ffbb4 req-5014965f-9ef6-4da2-a68e-7255c5adbab1 service nova] Creating event network-changed:1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 on user Apr 12 10:38:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-187760c8-4421-4610-b026-b1f90f7ffbb4 req-5014965f-9ef6-4da2-a68e-7255c5adbab1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067374 Apr 12 10:38:26 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 85/245] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:28 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-f5a8be17-5639-4666-91fd-7aab97934fe6 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:28 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-f5a8be17-5639-4666-91fd-7aab97934fe6 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5a8be17-5639-4666-91fd-7aab97934fe6 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5a8be17-5639-4666-91fd-7aab97934fe6 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5a8be17-5639-4666-91fd-7aab97934fe6 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5a8be17-5639-4666-91fd-7aab97934fe6 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5a8be17-5639-4666-91fd-7aab97934fe6 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5a8be17-5639-4666-91fd-7aab97934fe6 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:28 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-f5a8be17-5639-4666-91fd-7aab97934fe6 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] HTTP exception thrown: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:28 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-f5a8be17-5639-4666-91fd-7aab97934fe6 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Request method failure captured: Apr 12 10:38:28 user devstack@n-api.service[61852]: request: DELETE /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3 HTTP/1.1 Apr 12 10:38:28 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:38:28 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:38:28 user devstack@n-api.service[61852]: Connection: close Apr 12 10:38:28 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:38:28 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:38:28 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:38:28 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:38:28 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:38:28 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNol0WZCPr_v2iLXoikPTlSDtACQlck11lM4H3lkpmOGdNWHddbm4awov03rWzP4Ysb0q7nR5KihxSQt7MsCCGPckJx8TLjXllCXUXqSpvSs3lyXpD1JOLDFacl6dmShBMfTVnclMIDLFzzwmHXYi8X_KrFMkTvjueMv2KC6jOaWhXv0 Apr 12 10:38:28 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:38:28 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:38:28 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:38:28 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:38:28 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:38:28 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:38:28 user devstack@n-api.service[61852]: X-Project-Id: d3dbf247dab94f6eb32e7808314d420a Apr 12 10:38:28 user devstack@n-api.service[61852]: X-Project-Name: tempest-DeleteServersTestJSON-1147850030 Apr 12 10:38:28 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:38:28 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:38:28 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d3dbf247dab94f6eb32e7808314d420a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d3dbf247dab94f6eb32e7808314d420a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d3dbf247dab94f6eb32e7808314d420a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:38:28 user devstack@n-api.service[61852]: X-Tenant: tempest-DeleteServersTestJSON-1147850030 Apr 12 10:38:28 user devstack@n-api.service[61852]: X-Tenant-Id: d3dbf247dab94f6eb32e7808314d420a Apr 12 10:38:28 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-DeleteServersTestJSON-1147850030 Apr 12 10:38:28 user devstack@n-api.service[61852]: X-User: tempest-DeleteServersTestJSON-1147850030-project-member Apr 12 10:38:28 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:38:28 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:38:28 user devstack@n-api.service[61852]: X-User-Id: 3766c8ddd6ae4fdd9d4aa6929cc080cf Apr 12 10:38:28 user devstack@n-api.service[61852]: X-User-Name: tempest-DeleteServersTestJSON-1147850030-project-member Apr 12 10:38:28 user devstack@n-api.service[61852]: method: > Apr 12 10:38:28 user devstack@n-api.service[61852]: exception: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:28 user devstack@n-api.service[61852]: action_args: {'id': 'c4d49077-b100-4630-b4f8-00c3daffb9e3'} Apr 12 10:38:28 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:28 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:28 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-f5a8be17-5639-4666-91fd-7aab97934fe6 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Returning 404 to user: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:38:28 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-f5a8be17-5639-4666-91fd-7aab97934fe6 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3" status: 404 len: 111 microversion: 2.1 time: 0.031030 Apr 12 10:38:28 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 81/246] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:38:28 2023] DELETE /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:38:28 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-66bab2b6-4d9d-4de8-ae48-f5fbebe6f64d tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:28 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-66bab2b6-4d9d-4de8-ae48-f5fbebe6f64d tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-66bab2b6-4d9d-4de8-ae48-f5fbebe6f64d tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-66bab2b6-4d9d-4de8-ae48-f5fbebe6f64d tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-66bab2b6-4d9d-4de8-ae48-f5fbebe6f64d tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-66bab2b6-4d9d-4de8-ae48-f5fbebe6f64d tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-66bab2b6-4d9d-4de8-ae48-f5fbebe6f64d tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-66bab2b6-4d9d-4de8-ae48-f5fbebe6f64d tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-66bab2b6-4d9d-4de8-ae48-f5fbebe6f64d tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] HTTP exception thrown: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:28 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-66bab2b6-4d9d-4de8-ae48-f5fbebe6f64d tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Request method failure captured: Apr 12 10:38:28 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3 HTTP/1.1 Apr 12 10:38:28 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:38:28 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:38:28 user devstack@n-api.service[61853]: Connection: close Apr 12 10:38:28 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:38:28 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:38:28 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:38:28 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:38:28 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:38:28 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNol0WZCPr_v2iLXoikPTlSDtACQlck11lM4H3lkpmOGdNWHddbm4awov03rWzP4Ysb0q7nR5KihxSQt7MsCCGPckJx8TLjXllCXUXqSpvSs3lyXpD1JOLDFacl6dmShBMfTVnclMIDLFzzwmHXYi8X_KrFMkTvjueMv2KC6jOaWhXv0 Apr 12 10:38:28 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:38:28 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:38:28 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:38:28 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:38:28 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:38:28 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:38:28 user devstack@n-api.service[61853]: X-Project-Id: d3dbf247dab94f6eb32e7808314d420a Apr 12 10:38:28 user devstack@n-api.service[61853]: X-Project-Name: tempest-DeleteServersTestJSON-1147850030 Apr 12 10:38:28 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:38:28 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:38:28 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d3dbf247dab94f6eb32e7808314d420a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d3dbf247dab94f6eb32e7808314d420a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d3dbf247dab94f6eb32e7808314d420a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:38:28 user devstack@n-api.service[61853]: X-Tenant: tempest-DeleteServersTestJSON-1147850030 Apr 12 10:38:28 user devstack@n-api.service[61853]: X-Tenant-Id: d3dbf247dab94f6eb32e7808314d420a Apr 12 10:38:28 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-DeleteServersTestJSON-1147850030 Apr 12 10:38:28 user devstack@n-api.service[61853]: X-User: tempest-DeleteServersTestJSON-1147850030-project-member Apr 12 10:38:28 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:38:28 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:38:28 user devstack@n-api.service[61853]: X-User-Id: 3766c8ddd6ae4fdd9d4aa6929cc080cf Apr 12 10:38:28 user devstack@n-api.service[61853]: X-User-Name: tempest-DeleteServersTestJSON-1147850030-project-member Apr 12 10:38:28 user devstack@n-api.service[61853]: method: > Apr 12 10:38:28 user devstack@n-api.service[61853]: exception: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:28 user devstack@n-api.service[61853]: action_args: {'id': 'c4d49077-b100-4630-b4f8-00c3daffb9e3'} Apr 12 10:38:28 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. Apr 12 10:38:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:38:28 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-66bab2b6-4d9d-4de8-ae48-f5fbebe6f64d tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Returning 404 to user: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:38:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-66bab2b6-4d9d-4de8-ae48-f5fbebe6f64d tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3" status: 404 len: 111 microversion: 2.1 time: 0.029884 Apr 12 10:38:28 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 81/247] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:38:28 2023] GET /compute/v2.1/servers/c4d49077-b100-4630-b4f8-00c3daffb9e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:38:37 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=5 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:37 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=7 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:37 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-178fc40a-fc1a-404f-b950-cf90df0c6e99 req-b1c24c83-0cf4-4486-8a77-1a468fde6cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212", "name": "network-vif-plugged", "status": "completed", "tag": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-178fc40a-fc1a-404f-b950-cf90df0c6e99 req-b1c24c83-0cf4-4486-8a77-1a468fde6cb1 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-178fc40a-fc1a-404f-b950-cf90df0c6e99 req-b1c24c83-0cf4-4486-8a77-1a468fde6cb1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-178fc40a-fc1a-404f-b950-cf90df0c6e99 req-b1c24c83-0cf4-4486-8a77-1a468fde6cb1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:37 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-178fc40a-fc1a-404f-b950-cf90df0c6e99 req-b1c24c83-0cf4-4486-8a77-1a468fde6cb1 service nova] Creating event network-vif-plugged:1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 on user Apr 12 10:38:37 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-178fc40a-fc1a-404f-b950-cf90df0c6e99 req-b1c24c83-0cf4-4486-8a77-1a468fde6cb1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044772 Apr 12 10:38:37 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 86/248] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:38 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:38 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=11 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:38 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=11 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:38 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-72ebef73-a6e2-493c-96ea-93dc4d78baa9 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Action: 'create', calling method: .version_select at 0x7fabbf86cdc0>, body: {"keypair": {"name": "tempest-keypair-1823760254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Hsku+9Gq6PQ4eKPx2NZhPKKREpcJhVPgOkrPIzB0Og0vZ9OIo/sOZ0cMVzynU//y1O/biJFt/UdsDmp+9Toxz6/qyq8KmOhnHzR0d1UhA1wltYPUXYdlGdBHjOrPUqw=="}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:38 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-72ebef73-a6e2-493c-96ea-93dc4d78baa9 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Getting quotas for project af33ce0944194932b663c3b8aef9783d. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:38:38 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-72ebef73-a6e2-493c-96ea-93dc4d78baa9 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Getting quotas for user 47d6279f1ce94008a2898ade6f730b40 and project af33ce0944194932b663c3b8aef9783d. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:38:38 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-72ebef73-a6e2-493c-96ea-93dc4d78baa9 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.269218 Apr 12 10:38:38 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 82/249] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 10:38:38 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 271 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 10:38:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-bf6d224c-0170-47f2-82d8-4c39595b94bb req-6511488a-49b5-4f56-b5c3-f5a70c60d4ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212", "name": "network-vif-plugged", "status": "completed", "tag": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:39 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:39 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:39 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:39 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-bf6d224c-0170-47f2-82d8-4c39595b94bb req-6511488a-49b5-4f56-b5c3-f5a70c60d4ea service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-bf6d224c-0170-47f2-82d8-4c39595b94bb req-6511488a-49b5-4f56-b5c3-f5a70c60d4ea service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-bf6d224c-0170-47f2-82d8-4c39595b94bb req-6511488a-49b5-4f56-b5c3-f5a70c60d4ea service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-bf6d224c-0170-47f2-82d8-4c39595b94bb req-6511488a-49b5-4f56-b5c3-f5a70c60d4ea service nova] Creating event network-vif-plugged:1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 on user Apr 12 10:38:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-bf6d224c-0170-47f2-82d8-4c39595b94bb req-6511488a-49b5-4f56-b5c3-f5a70c60d4ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038169 Apr 12 10:38:39 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 82/250] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1310544900", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18"}], "security_groups": [{"name": "tempest-securitygroup--720041656"}], "key_name": "tempest-keypair-1823760254", "user_data": "}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:40 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] validate_networks() for [('aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:38:40 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:38:40 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:38:40 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:38:40 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:38:40 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:38:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:40 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Getting quotas for project af33ce0944194932b663c3b8aef9783d. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:38:40 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Getting quotas for user 47d6279f1ce94008a2898ade6f730b40 and project af33ce0944194932b663c3b8aef9783d. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:38:40 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:38:40 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:38:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.772230 Apr 12 10:38:40 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 87/251] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 10:38:40 2023] POST /compute/v2.1/servers => generated 399 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 10:38:40 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-17d8bcd6-1fdc-455b-8c61-d7ec98c4afea tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:40 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-17d8bcd6-1fdc-455b-8c61-d7ec98c4afea tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:40 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-17d8bcd6-1fdc-455b-8c61-d7ec98c4afea tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:40 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-17d8bcd6-1fdc-455b-8c61-d7ec98c4afea tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:40 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-17d8bcd6-1fdc-455b-8c61-d7ec98c4afea tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:40 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-17d8bcd6-1fdc-455b-8c61-d7ec98c4afea tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa" status: 200 len: 1276 microversion: 2.20 time: 0.068943 Apr 12 10:38:40 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 83/252] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:38:40 2023] GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa => generated 1276 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:38:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-9532452b-a9a4-4860-a231-59af2f69e7ac req-2909a70d-3334-4c67-a07f-6232c1135d9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bfafa79-ce40-42f1-9992-10e50734f7fa", "tag": "4de5a799-c343-4e41-88ef-ebaaa3adb14c"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9532452b-a9a4-4860-a231-59af2f69e7ac req-2909a70d-3334-4c67-a07f-6232c1135d9c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9532452b-a9a4-4860-a231-59af2f69e7ac req-2909a70d-3334-4c67-a07f-6232c1135d9c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9532452b-a9a4-4860-a231-59af2f69e7ac req-2909a70d-3334-4c67-a07f-6232c1135d9c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-9532452b-a9a4-4860-a231-59af2f69e7ac req-2909a70d-3334-4c67-a07f-6232c1135d9c service nova] Creating event network-changed:4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance 0bfafa79-ce40-42f1-9992-10e50734f7fa on user Apr 12 10:38:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-9532452b-a9a4-4860-a231-59af2f69e7ac req-2909a70d-3334-4c67-a07f-6232c1135d9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031660 Apr 12 10:38:43 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 83/253] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:44 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e648337e-3213-4887-a883-99cf290df07a tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:44 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e648337e-3213-4887-a883-99cf290df07a tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e648337e-3213-4887-a883-99cf290df07a tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e648337e-3213-4887-a883-99cf290df07a tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e648337e-3213-4887-a883-99cf290df07a tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e648337e-3213-4887-a883-99cf290df07a tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e648337e-3213-4887-a883-99cf290df07a tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e648337e-3213-4887-a883-99cf290df07a tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-e648337e-3213-4887-a883-99cf290df07a tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049203 Apr 12 10:38:44 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 88/254] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:38:44 2023] GET /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 10:38:44 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1187530573", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "networks": [{"uuid": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0"}]}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:44 user devstack@n-api.service[61852]: DEBUG nova.network.neutron [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] validate_networks() for [('66f6d7b6-8980-47a3-a7b6-f62db8264cd0', None, None, None, None, None)] {{(pid=61852) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:38:45 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Flavor limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:38:45 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Image limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:38:45 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Flavor pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:38:45 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Image pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:38:45 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:38:45 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:45 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:45 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:45 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:45 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:45 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:45 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Getting quotas for project 0cdb8217b1544db384bebe1059848bb6. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:38:45 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Getting quotas for user a0a2243c6c9f431da846cc54ec181fcc and project 0cdb8217b1544db384bebe1059848bb6. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:38:45 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Going to run 1 instances... {{(pid=61852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:38:45 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:38:45 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.496968 Apr 12 10:38:45 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 84/255] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:38:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:38:45 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4a5e4350-65da-4504-b749-21d159b0941b tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:45 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-4a5e4350-65da-4504-b749-21d159b0941b tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:46 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-e66e6b10-9b74-4c34-b5eb-101ac2703bbf req-0fce10c3-2ebb-4867-8e9f-a83a5cf88e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bfafa79-ce40-42f1-9992-10e50734f7fa", "name": "network-vif-plugged", "status": "completed", "tag": "4de5a799-c343-4e41-88ef-ebaaa3adb14c"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e66e6b10-9b74-4c34-b5eb-101ac2703bbf req-0fce10c3-2ebb-4867-8e9f-a83a5cf88e25 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e66e6b10-9b74-4c34-b5eb-101ac2703bbf req-0fce10c3-2ebb-4867-8e9f-a83a5cf88e25 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e66e6b10-9b74-4c34-b5eb-101ac2703bbf req-0fce10c3-2ebb-4867-8e9f-a83a5cf88e25 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:46 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-e66e6b10-9b74-4c34-b5eb-101ac2703bbf req-0fce10c3-2ebb-4867-8e9f-a83a5cf88e25 service nova] Creating event network-vif-plugged:4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance 0bfafa79-ce40-42f1-9992-10e50734f7fa on user Apr 12 10:38:46 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-e66e6b10-9b74-4c34-b5eb-101ac2703bbf req-0fce10c3-2ebb-4867-8e9f-a83a5cf88e25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033517 Apr 12 10:38:46 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 89/256] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:46 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-4a5e4350-65da-4504-b749-21d159b0941b tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a2243c6c9f431da846cc54ec181fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb8217b1544db384bebe1059848bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:46 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-4a5e4350-65da-4504-b749-21d159b0941b tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c663163-6794-4c92-a401-5bc15d112c65" status: 200 len: 1212 microversion: 2.1 time: 0.712058 Apr 12 10:38:46 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 84/257] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:38:45 2023] GET /compute/v2.1/servers/1c663163-6794-4c92-a401-5bc15d112c65 => generated 1212 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:38:48 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bfafa79-ce40-42f1-9992-10e50734f7fa", "name": "network-vif-plugged", "status": "completed", "tag": "4de5a799-c343-4e41-88ef-ebaaa3adb14c"}, {"name": "network-changed", "server_uuid": "1c663163-6794-4c92-a401-5bc15d112c65", "tag": "6b5da29f-d5cb-4af2-ab48-c296b053e407"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:48 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:48 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:48 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:48 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] Creating event network-vif-plugged:4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance 0bfafa79-ce40-42f1-9992-10e50734f7fa on user Apr 12 10:38:48 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] Creating event network-changed:6b5da29f-d5cb-4af2-ab48-c296b053e407 for instance 1c663163-6794-4c92-a401-5bc15d112c65 on user Apr 12 10:38:48 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.032636 Apr 12 10:38:48 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 85/258] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:48 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-6ac64dfd-2b30-47f9-8e4f-2cbcc7f2f8f9 req-2da8e2f7-7304-4aa1-9af8-3fdd7d414c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c663163-6794-4c92-a401-5bc15d112c65", "name": "network-vif-plugged", "status": "completed", "tag": "6b5da29f-d5cb-4af2-ab48-c296b053e407"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-6ac64dfd-2b30-47f9-8e4f-2cbcc7f2f8f9 req-2da8e2f7-7304-4aa1-9af8-3fdd7d414c57 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-6ac64dfd-2b30-47f9-8e4f-2cbcc7f2f8f9 req-2da8e2f7-7304-4aa1-9af8-3fdd7d414c57 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-6ac64dfd-2b30-47f9-8e4f-2cbcc7f2f8f9 req-2da8e2f7-7304-4aa1-9af8-3fdd7d414c57 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-6ac64dfd-2b30-47f9-8e4f-2cbcc7f2f8f9 req-2da8e2f7-7304-4aa1-9af8-3fdd7d414c57 service nova] Creating event network-vif-plugged:6b5da29f-d5cb-4af2-ab48-c296b053e407 for instance 1c663163-6794-4c92-a401-5bc15d112c65 on user Apr 12 10:38:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-6ac64dfd-2b30-47f9-8e4f-2cbcc7f2f8f9 req-2da8e2f7-7304-4aa1-9af8-3fdd7d414c57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037031 Apr 12 10:38:50 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 90/259] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-2fb25d47-2dbe-4343-b685-143440076fe5 req-c86989e6-3302-401c-878a-d409fed2a724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c663163-6794-4c92-a401-5bc15d112c65", "name": "network-vif-plugged", "status": "completed", "tag": "6b5da29f-d5cb-4af2-ab48-c296b053e407"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:38:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-2fb25d47-2dbe-4343-b685-143440076fe5 req-c86989e6-3302-401c-878a-d409fed2a724 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-2fb25d47-2dbe-4343-b685-143440076fe5 req-c86989e6-3302-401c-878a-d409fed2a724 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-2fb25d47-2dbe-4343-b685-143440076fe5 req-c86989e6-3302-401c-878a-d409fed2a724 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-2fb25d47-2dbe-4343-b685-143440076fe5 req-c86989e6-3302-401c-878a-d409fed2a724 service nova] Creating event network-vif-plugged:6b5da29f-d5cb-4af2-ab48-c296b053e407 for instance 1c663163-6794-4c92-a401-5bc15d112c65 on user Apr 12 10:38:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-2fb25d47-2dbe-4343-b685-143440076fe5 req-c86989e6-3302-401c-878a-d409fed2a724 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031229 Apr 12 10:38:52 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 85/260] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:38:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:38:54 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-968671a9-fc4a-4fc7-b9eb-932f9cb2ed0b tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:54 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-968671a9-fc4a-4fc7-b9eb-932f9cb2ed0b tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-968671a9-fc4a-4fc7-b9eb-932f9cb2ed0b tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-968671a9-fc4a-4fc7-b9eb-932f9cb2ed0b tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-968671a9-fc4a-4fc7-b9eb-932f9cb2ed0b tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-968671a9-fc4a-4fc7-b9eb-932f9cb2ed0b tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-968671a9-fc4a-4fc7-b9eb-932f9cb2ed0b tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-968671a9-fc4a-4fc7-b9eb-932f9cb2ed0b tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:54 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-968671a9-fc4a-4fc7-b9eb-932f9cb2ed0b tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] HTTP exception thrown: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. Apr 12 10:38:54 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-968671a9-fc4a-4fc7-b9eb-932f9cb2ed0b tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Request method failure captured: Apr 12 10:38:54 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e HTTP/1.1 Apr 12 10:38:54 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:38:54 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:38:54 user devstack@n-api.service[61852]: Connection: close Apr 12 10:38:54 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:38:54 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:38:54 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:38:54 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:38:54 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:38:54 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNolpP_I7-oc7zt1wWLsOv7w07e0Fh-uGjxHoVDGhEJB2ga5I-BXuPsoPDXfw5uWpYm7YzkIzxdGHEvVqLBGFa3KgkWIiwr3Hc-XmsPdiPQA0K6zoPH1kF4hBPfyPzZucQR672io7cpJJcZKdS_r6s-KXVw5HK8Rn1rPmxDKSnvjR5JQ Apr 12 10:38:54 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:38:54 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:38:54 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:38:54 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:38:54 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:38:54 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:38:54 user devstack@n-api.service[61852]: X-Project-Id: cede3351295e451283a0414aefea1de5 Apr 12 10:38:54 user devstack@n-api.service[61852]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-384950708 Apr 12 10:38:54 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:38:54 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:38:54 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cede3351295e451283a0414aefea1de5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cede3351295e451283a0414aefea1de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cede3351295e451283a0414aefea1de5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:38:54 user devstack@n-api.service[61852]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-384950708 Apr 12 10:38:54 user devstack@n-api.service[61852]: X-Tenant-Id: cede3351295e451283a0414aefea1de5 Apr 12 10:38:54 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-384950708 Apr 12 10:38:54 user devstack@n-api.service[61852]: X-User: tempest-AttachSCSIVolumeTestJSON-384950708-project-member Apr 12 10:38:54 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:38:54 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:38:54 user devstack@n-api.service[61852]: X-User-Id: b2f1517aae734c8aa5b0acbc906af9c0 Apr 12 10:38:54 user devstack@n-api.service[61852]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-384950708-project-member Apr 12 10:38:54 user devstack@n-api.service[61852]: method: > Apr 12 10:38:54 user devstack@n-api.service[61852]: exception: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. Apr 12 10:38:54 user devstack@n-api.service[61852]: action_args: {'id': '3d261c30-0c6f-4d1b-8965-448dc019728e'} Apr 12 10:38:54 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. Apr 12 10:38:54 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:54 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-968671a9-fc4a-4fc7-b9eb-932f9cb2ed0b tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Returning 404 to user: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:38:54 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-968671a9-fc4a-4fc7-b9eb-932f9cb2ed0b tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e" status: 404 len: 111 microversion: 2.1 time: 0.033010 Apr 12 10:38:54 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 86/261] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:38:54 2023] GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:38:54 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-1f5725fd-bbb7-4522-889b-60796b7be4ff tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Calling method '.version_select at 0x7fabbf9381f0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:54 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:54 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-1f5725fd-bbb7-4522-889b-60796b7be4ff tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229893823" status: 202 len: 0 microversion: 2.1 time: 0.030450 Apr 12 10:38:54 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 91/262] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 10:38:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229893823 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:38:57 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:57 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-eeb46aa3-d90b-4517-b9f4-6c12b5f937bb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:57 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-eeb46aa3-d90b-4517-b9f4-6c12b5f937bb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eeb46aa3-d90b-4517-b9f4-6c12b5f937bb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eeb46aa3-d90b-4517-b9f4-6c12b5f937bb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eeb46aa3-d90b-4517-b9f4-6c12b5f937bb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eeb46aa3-d90b-4517-b9f4-6c12b5f937bb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eeb46aa3-d90b-4517-b9f4-6c12b5f937bb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eeb46aa3-d90b-4517-b9f4-6c12b5f937bb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:57 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-eeb46aa3-d90b-4517-b9f4-6c12b5f937bb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] HTTP exception thrown: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. Apr 12 10:38:57 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-eeb46aa3-d90b-4517-b9f4-6c12b5f937bb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Request method failure captured: Apr 12 10:38:57 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e HTTP/1.1 Apr 12 10:38:57 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:38:57 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:38:57 user devstack@n-api.service[61853]: Connection: close Apr 12 10:38:57 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:38:57 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:38:57 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:38:57 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:38:57 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:38:57 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolpP_I7-oc7zt1wWLsOv7w07e0Fh-uGjxHoVDGhEJB2ga5I-BXuPsoPDXfw5uWpYm7YzkIzxdGHEvVqLBGFa3KgkWIiwr3Hc-XmsPdiPQA0K6zoPH1kF4hBPfyPzZucQR672io7cpJJcZKdS_r6s-KXVw5HK8Rn1rPmxDKSnvjR5JQ Apr 12 10:38:57 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:38:57 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:38:57 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:38:57 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:38:57 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:38:57 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:38:57 user devstack@n-api.service[61853]: X-Project-Id: cede3351295e451283a0414aefea1de5 Apr 12 10:38:57 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-384950708 Apr 12 10:38:57 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:38:57 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:38:57 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cede3351295e451283a0414aefea1de5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cede3351295e451283a0414aefea1de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cede3351295e451283a0414aefea1de5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:38:57 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-384950708 Apr 12 10:38:57 user devstack@n-api.service[61853]: X-Tenant-Id: cede3351295e451283a0414aefea1de5 Apr 12 10:38:57 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-384950708 Apr 12 10:38:57 user devstack@n-api.service[61853]: X-User: tempest-AttachSCSIVolumeTestJSON-384950708-project-member Apr 12 10:38:57 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:38:57 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:38:57 user devstack@n-api.service[61853]: X-User-Id: b2f1517aae734c8aa5b0acbc906af9c0 Apr 12 10:38:57 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-384950708-project-member Apr 12 10:38:57 user devstack@n-api.service[61853]: method: > Apr 12 10:38:57 user devstack@n-api.service[61853]: exception: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. Apr 12 10:38:57 user devstack@n-api.service[61853]: action_args: {'id': '3d261c30-0c6f-4d1b-8965-448dc019728e'} Apr 12 10:38:57 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. Apr 12 10:38:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:38:57 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-eeb46aa3-d90b-4517-b9f4-6c12b5f937bb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Returning 404 to user: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:38:57 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-eeb46aa3-d90b-4517-b9f4-6c12b5f937bb tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e" status: 404 len: 111 microversion: 2.1 time: 0.030343 Apr 12 10:38:57 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 86/263] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:38:57 2023] DELETE /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:38:57 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-a640453a-b33b-44bd-b92e-7eb247c99175 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:57 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-a640453a-b33b-44bd-b92e-7eb247c99175 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:57 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:57 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=12 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:38:57 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a640453a-b33b-44bd-b92e-7eb247c99175 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:57 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a640453a-b33b-44bd-b92e-7eb247c99175 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:57 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a640453a-b33b-44bd-b92e-7eb247c99175 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:57 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a640453a-b33b-44bd-b92e-7eb247c99175 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:57 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a640453a-b33b-44bd-b92e-7eb247c99175 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:57 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a640453a-b33b-44bd-b92e-7eb247c99175 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:57 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-a640453a-b33b-44bd-b92e-7eb247c99175 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] HTTP exception thrown: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. Apr 12 10:38:57 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-a640453a-b33b-44bd-b92e-7eb247c99175 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Request method failure captured: Apr 12 10:38:57 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e HTTP/1.1 Apr 12 10:38:57 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:38:57 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:38:57 user devstack@n-api.service[61852]: Connection: close Apr 12 10:38:57 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:38:57 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:38:57 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:38:57 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:38:57 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:38:57 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNolpP_I7-oc7zt1wWLsOv7w07e0Fh-uGjxHoVDGhEJB2ga5I-BXuPsoPDXfw5uWpYm7YzkIzxdGHEvVqLBGFa3KgkWIiwr3Hc-XmsPdiPQA0K6zoPH1kF4hBPfyPzZucQR672io7cpJJcZKdS_r6s-KXVw5HK8Rn1rPmxDKSnvjR5JQ Apr 12 10:38:57 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:38:57 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:38:57 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:38:57 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:38:57 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:38:57 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:38:57 user devstack@n-api.service[61852]: X-Project-Id: cede3351295e451283a0414aefea1de5 Apr 12 10:38:57 user devstack@n-api.service[61852]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-384950708 Apr 12 10:38:57 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:38:57 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:38:57 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cede3351295e451283a0414aefea1de5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cede3351295e451283a0414aefea1de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cede3351295e451283a0414aefea1de5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:38:57 user devstack@n-api.service[61852]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-384950708 Apr 12 10:38:57 user devstack@n-api.service[61852]: X-Tenant-Id: cede3351295e451283a0414aefea1de5 Apr 12 10:38:57 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-384950708 Apr 12 10:38:57 user devstack@n-api.service[61852]: X-User: tempest-AttachSCSIVolumeTestJSON-384950708-project-member Apr 12 10:38:57 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:38:57 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:38:57 user devstack@n-api.service[61852]: X-User-Id: b2f1517aae734c8aa5b0acbc906af9c0 Apr 12 10:38:57 user devstack@n-api.service[61852]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-384950708-project-member Apr 12 10:38:57 user devstack@n-api.service[61852]: method: > Apr 12 10:38:57 user devstack@n-api.service[61852]: exception: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. Apr 12 10:38:57 user devstack@n-api.service[61852]: action_args: {'id': '3d261c30-0c6f-4d1b-8965-448dc019728e'} Apr 12 10:38:57 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. Apr 12 10:38:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:38:57 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-a640453a-b33b-44bd-b92e-7eb247c99175 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Returning 404 to user: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:38:57 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-a640453a-b33b-44bd-b92e-7eb247c99175 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e" status: 404 len: 111 microversion: 2.1 time: 0.041078 Apr 12 10:38:57 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 87/264] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:38:57 2023] GET /compute/v2.1/servers/3d261c30-0c6f-4d1b-8965-448dc019728e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:38:58 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-36eaae7f-4c40-481d-af2a-943769373eb6 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:38:58 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-36eaae7f-4c40-481d-af2a-943769373eb6 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:38:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36eaae7f-4c40-481d-af2a-943769373eb6 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36eaae7f-4c40-481d-af2a-943769373eb6 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36eaae7f-4c40-481d-af2a-943769373eb6 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36eaae7f-4c40-481d-af2a-943769373eb6 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:38:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36eaae7f-4c40-481d-af2a-943769373eb6 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:38:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36eaae7f-4c40-481d-af2a-943769373eb6 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:38:58 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-36eaae7f-4c40-481d-af2a-943769373eb6 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c97c57a3e7142d088e1cf315f5d8d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16de154a6d344b18a939c6a1b1a679f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:38:58 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-36eaae7f-4c40-481d-af2a-943769373eb6 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" status: 200 len: 1496 microversion: 2.1 time: 0.165250 Apr 12 10:38:58 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 92/265] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:38:58 2023] GET /compute/v2.1/servers/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 => generated 1496 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:39:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-14fe63c4-c739-42d5-ae38-8dd00cdf2cca tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:01 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-14fe63c4-c739-42d5-ae38-8dd00cdf2cca tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-14fe63c4-c739-42d5-ae38-8dd00cdf2cca tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-14fe63c4-c739-42d5-ae38-8dd00cdf2cca tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-14fe63c4-c739-42d5-ae38-8dd00cdf2cca tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-14fe63c4-c739-42d5-ae38-8dd00cdf2cca tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-14fe63c4-c739-42d5-ae38-8dd00cdf2cca tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-14fe63c4-c739-42d5-ae38-8dd00cdf2cca tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-14fe63c4-c739-42d5-ae38-8dd00cdf2cca tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266/os-instance-actions/req-03634afc-4aee-4999-bf7e-4f554c0cfb2a" status: 200 len: 503 microversion: 2.49 time: 0.087461 Apr 12 10:39:01 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 87/266] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 10:39:01 2023] GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266/os-instance-actions/req-03634afc-4aee-4999-bf7e-4f554c0cfb2a => generated 503 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-8b62a0a2-68f4-45bd-a8fe-24955bb9f6cd tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-8b62a0a2-68f4-45bd-a8fe-24955bb9f6cd tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8b62a0a2-68f4-45bd-a8fe-24955bb9f6cd tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8b62a0a2-68f4-45bd-a8fe-24955bb9f6cd tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8b62a0a2-68f4-45bd-a8fe-24955bb9f6cd tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8b62a0a2-68f4-45bd-a8fe-24955bb9f6cd tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8b62a0a2-68f4-45bd-a8fe-24955bb9f6cd tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8b62a0a2-68f4-45bd-a8fe-24955bb9f6cd tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:01 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-8b62a0a2-68f4-45bd-a8fe-24955bb9f6cd tempest-TaggedAttachmentsTest-1850827024 tempest-TaggedAttachmentsTest-1850827024-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266/os-instance-actions/req-03634afc-4aee-4999-bf7e-4f554c0cfb2a" status: 200 len: 503 microversion: 2.49 time: 0.043843 Apr 12 10:39:01 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 88/267] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 10:39:01 2023] GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266/os-instance-actions/req-03634afc-4aee-4999-bf7e-4f554c0cfb2a => generated 503 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:39:01 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d40e2efa-34a4-421a-8570-6f5fe1b7f479 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:01 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d40e2efa-34a4-421a-8570-6f5fe1b7f479 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d40e2efa-34a4-421a-8570-6f5fe1b7f479 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d40e2efa-34a4-421a-8570-6f5fe1b7f479 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d40e2efa-34a4-421a-8570-6f5fe1b7f479 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d40e2efa-34a4-421a-8570-6f5fe1b7f479 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d40e2efa-34a4-421a-8570-6f5fe1b7f479 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d40e2efa-34a4-421a-8570-6f5fe1b7f479 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:01 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d40e2efa-34a4-421a-8570-6f5fe1b7f479 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.045278 Apr 12 10:39:01 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 93/268] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 10:39:01 2023] GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:39:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:01 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:01 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:39:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266" status: 204 len: 0 microversion: 2.49 time: 0.122096 Apr 12 10:39:01 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 88/269] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 10:39:01 2023] DELETE /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-8488b817-a92b-4a8f-a90b-007a5ef3d2e2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-8488b817-a92b-4a8f-a90b-007a5ef3d2e2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8488b817-a92b-4a8f-a90b-007a5ef3d2e2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8488b817-a92b-4a8f-a90b-007a5ef3d2e2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8488b817-a92b-4a8f-a90b-007a5ef3d2e2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8488b817-a92b-4a8f-a90b-007a5ef3d2e2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8488b817-a92b-4a8f-a90b-007a5ef3d2e2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8488b817-a92b-4a8f-a90b-007a5ef3d2e2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-8488b817-a92b-4a8f-a90b-007a5ef3d2e2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '254d3560065c4d8a8aaf312870be2967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6981486a29b64ee7b9ef7cbf2ca852be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-8488b817-a92b-4a8f-a90b-007a5ef3d2e2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '254d3560065c4d8a8aaf312870be2967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6981486a29b64ee7b9ef7cbf2ca852be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:01 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-8488b817-a92b-4a8f-a90b-007a5ef3d2e2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '254d3560065c4d8a8aaf312870be2967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6981486a29b64ee7b9ef7cbf2ca852be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:01 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-8488b817-a92b-4a8f-a90b-007a5ef3d2e2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266" status: 200 len: 1750 microversion: 2.49 time: 0.260574 Apr 12 10:39:01 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 89/270] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:39:01 2023] GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266 => generated 1750 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:39:01 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-59f812ed-922c-4a1d-9279-05653bbcedea req-cdd7a5a3-86aa-4823-9e5f-fc0c5dbc5410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f147b4ee-d130-41ae-a4db-bc248fb23266", "name": "network-vif-unplugged", "status": "completed", "tag": "96998164-acd9-4a18-b230-d63787eaf154"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-59f812ed-922c-4a1d-9279-05653bbcedea req-cdd7a5a3-86aa-4823-9e5f-fc0c5dbc5410 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-59f812ed-922c-4a1d-9279-05653bbcedea req-cdd7a5a3-86aa-4823-9e5f-fc0c5dbc5410 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-59f812ed-922c-4a1d-9279-05653bbcedea req-cdd7a5a3-86aa-4823-9e5f-fc0c5dbc5410 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:01 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-59f812ed-922c-4a1d-9279-05653bbcedea req-cdd7a5a3-86aa-4823-9e5f-fc0c5dbc5410 service nova] Creating event network-vif-unplugged:96998164-acd9-4a18-b230-d63787eaf154 for instance f147b4ee-d130-41ae-a4db-bc248fb23266 on user Apr 12 10:39:01 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-59f812ed-922c-4a1d-9279-05653bbcedea req-cdd7a5a3-86aa-4823-9e5f-fc0c5dbc5410 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037843 Apr 12 10:39:01 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 94/271] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:39:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:39:02 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-65000bf0-eafe-4439-bad7-893581bd08ba tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:02 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-65000bf0-eafe-4439-bad7-893581bd08ba tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-65000bf0-eafe-4439-bad7-893581bd08ba tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-65000bf0-eafe-4439-bad7-893581bd08ba tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-65000bf0-eafe-4439-bad7-893581bd08ba tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-65000bf0-eafe-4439-bad7-893581bd08ba tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-65000bf0-eafe-4439-bad7-893581bd08ba tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-65000bf0-eafe-4439-bad7-893581bd08ba tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-65000bf0-eafe-4439-bad7-893581bd08ba tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] HTTP exception thrown: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. Apr 12 10:39:02 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-65000bf0-eafe-4439-bad7-893581bd08ba tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Request method failure captured: Apr 12 10:39:02 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3 HTTP/1.1 Apr 12 10:39:02 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:39:02 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:39:02 user devstack@n-api.service[61853]: Connection: close Apr 12 10:39:02 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:39:02 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:39:02 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:39:02 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:39:02 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:39:02 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolj0u_TGTQ98P41e8rNAwIVzEqripLicMesoooadQuXD48axqsd3d6HoE0R4tJKaai-RF2oHx379l_8BTtyODN6n9zY-TA0_0R0EB4GucSrwLFCTdnYZeyXH69PyvcPeJaBLfhWFgsLJ5WHZ64PFz1--kBeKiYujm46n4gh71VNBlM Apr 12 10:39:02 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:39:02 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:39:02 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:39:02 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:39:02 user devstack@n-api.service[61853]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 10:39:02 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:39:02 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:39:02 user devstack@n-api.service[61853]: X-Project-Id: 1fcfbd94249342b2a436d2592e0dc9bf Apr 12 10:39:02 user devstack@n-api.service[61853]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-639083036 Apr 12 10:39:02 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:39:02 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:39:02 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1fcfbd94249342b2a436d2592e0dc9bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fcfbd94249342b2a436d2592e0dc9bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fcfbd94249342b2a436d2592e0dc9bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:39:02 user devstack@n-api.service[61853]: X-Tenant: tempest-TaggedBootDevicesTest_v242-639083036 Apr 12 10:39:02 user devstack@n-api.service[61853]: X-Tenant-Id: 1fcfbd94249342b2a436d2592e0dc9bf Apr 12 10:39:02 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-639083036 Apr 12 10:39:02 user devstack@n-api.service[61853]: X-User: tempest-TaggedBootDevicesTest_v242-639083036-project-member Apr 12 10:39:02 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:39:02 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:39:02 user devstack@n-api.service[61853]: X-User-Id: 949ebef2d45b4d64a89a11d837dfffd3 Apr 12 10:39:02 user devstack@n-api.service[61853]: X-User-Name: tempest-TaggedBootDevicesTest_v242-639083036-project-member Apr 12 10:39:02 user devstack@n-api.service[61853]: method: > Apr 12 10:39:02 user devstack@n-api.service[61853]: exception: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. Apr 12 10:39:02 user devstack@n-api.service[61853]: action_args: {'id': 'b9fd76e3-c7ed-4631-b056-3bd13439f7d3'} Apr 12 10:39:02 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. Apr 12 10:39:02 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:39:02 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-65000bf0-eafe-4439-bad7-893581bd08ba tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Returning 404 to user: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:39:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-65000bf0-eafe-4439-bad7-893581bd08ba tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3" status: 404 len: 111 microversion: 2.42 time: 0.039917 Apr 12 10:39:02 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 89/272] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:39:02 2023] GET /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:39:02 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-e073ea69-cc41-4ca5-8d8e-c063521c6e3c tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Calling method '.version_select at 0x7fabbf86f910>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:02 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-e073ea69-cc41-4ca5-8d8e-c063521c6e3c tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1600069342" status: 204 len: 0 microversion: 2.42 time: 0.023397 Apr 12 10:39:02 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 90/273] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 10:39:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1600069342 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 12 10:39:04 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-2c026496-ed83-455f-82a8-47059884ceaf req-ae83b9e9-6659-4403-9fe4-d009fa88b5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f147b4ee-d130-41ae-a4db-bc248fb23266", "name": "network-vif-plugged", "status": "completed", "tag": "96998164-acd9-4a18-b230-d63787eaf154"}, {"server_uuid": "f147b4ee-d130-41ae-a4db-bc248fb23266", "name": "network-vif-deleted", "tag": "96998164-acd9-4a18-b230-d63787eaf154"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2c026496-ed83-455f-82a8-47059884ceaf req-ae83b9e9-6659-4403-9fe4-d009fa88b5d1 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2c026496-ed83-455f-82a8-47059884ceaf req-ae83b9e9-6659-4403-9fe4-d009fa88b5d1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2c026496-ed83-455f-82a8-47059884ceaf req-ae83b9e9-6659-4403-9fe4-d009fa88b5d1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-2c026496-ed83-455f-82a8-47059884ceaf req-ae83b9e9-6659-4403-9fe4-d009fa88b5d1 service nova] Creating event network-vif-plugged:96998164-acd9-4a18-b230-d63787eaf154 for instance f147b4ee-d130-41ae-a4db-bc248fb23266 on user Apr 12 10:39:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-2c026496-ed83-455f-82a8-47059884ceaf req-ae83b9e9-6659-4403-9fe4-d009fa88b5d1 service nova] Creating event network-vif-deleted:96998164-acd9-4a18-b230-d63787eaf154 for instance f147b4ee-d130-41ae-a4db-bc248fb23266 on user Apr 12 10:39:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-2c026496-ed83-455f-82a8-47059884ceaf req-ae83b9e9-6659-4403-9fe4-d009fa88b5d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036845 Apr 12 10:39:04 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 95/274] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:39:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:39:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ab40b640-eda3-41f9-baf6-e57a3d52025c tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:07 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-ab40b640-eda3-41f9-baf6-e57a3d52025c tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ab40b640-eda3-41f9-baf6-e57a3d52025c tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ab40b640-eda3-41f9-baf6-e57a3d52025c tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ab40b640-eda3-41f9-baf6-e57a3d52025c tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ab40b640-eda3-41f9-baf6-e57a3d52025c tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ab40b640-eda3-41f9-baf6-e57a3d52025c tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ab40b640-eda3-41f9-baf6-e57a3d52025c tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-ab40b640-eda3-41f9-baf6-e57a3d52025c tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] HTTP exception thrown: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. Apr 12 10:39:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ab40b640-eda3-41f9-baf6-e57a3d52025c tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Request method failure captured: Apr 12 10:39:07 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3 HTTP/1.1 Apr 12 10:39:07 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:39:07 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:39:07 user devstack@n-api.service[61853]: Connection: close Apr 12 10:39:07 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:39:07 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:39:07 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:39:07 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:39:07 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:39:07 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolj0u_TGTQ98P41e8rNAwIVzEqripLicMesoooadQuXD48axqsd3d6HoE0R4tJKaai-RF2oHx379l_8BTtyODN6n9zY-TA0_0R0EB4GucSrwLFCTdnYZeyXH69PyvcPeJaBLfhWFgsLJ5WHZ64PFz1--kBeKiYujm46n4gh71VNBlM Apr 12 10:39:07 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:39:07 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:39:07 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:39:07 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:39:07 user devstack@n-api.service[61853]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 10:39:07 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:39:07 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:39:07 user devstack@n-api.service[61853]: X-Project-Id: 1fcfbd94249342b2a436d2592e0dc9bf Apr 12 10:39:07 user devstack@n-api.service[61853]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-639083036 Apr 12 10:39:07 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:39:07 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:39:07 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1fcfbd94249342b2a436d2592e0dc9bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fcfbd94249342b2a436d2592e0dc9bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fcfbd94249342b2a436d2592e0dc9bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:39:07 user devstack@n-api.service[61853]: X-Tenant: tempest-TaggedBootDevicesTest_v242-639083036 Apr 12 10:39:07 user devstack@n-api.service[61853]: X-Tenant-Id: 1fcfbd94249342b2a436d2592e0dc9bf Apr 12 10:39:07 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-639083036 Apr 12 10:39:07 user devstack@n-api.service[61853]: X-User: tempest-TaggedBootDevicesTest_v242-639083036-project-member Apr 12 10:39:07 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:39:07 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:39:07 user devstack@n-api.service[61853]: X-User-Id: 949ebef2d45b4d64a89a11d837dfffd3 Apr 12 10:39:07 user devstack@n-api.service[61853]: X-User-Name: tempest-TaggedBootDevicesTest_v242-639083036-project-member Apr 12 10:39:07 user devstack@n-api.service[61853]: method: > Apr 12 10:39:07 user devstack@n-api.service[61853]: exception: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. Apr 12 10:39:07 user devstack@n-api.service[61853]: action_args: {'id': 'b9fd76e3-c7ed-4631-b056-3bd13439f7d3'} Apr 12 10:39:07 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. Apr 12 10:39:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:39:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ab40b640-eda3-41f9-baf6-e57a3d52025c tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Returning 404 to user: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:39:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-ab40b640-eda3-41f9-baf6-e57a3d52025c tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3" status: 404 len: 111 microversion: 2.42 time: 0.036774 Apr 12 10:39:07 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 90/275] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 10:39:07 2023] DELETE /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:39:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-0ee9fb07-0cc5-4689-a298-2f4f5ff71c5b tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:07 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-0ee9fb07-0cc5-4689-a298-2f4f5ff71c5b tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0ee9fb07-0cc5-4689-a298-2f4f5ff71c5b tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0ee9fb07-0cc5-4689-a298-2f4f5ff71c5b tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0ee9fb07-0cc5-4689-a298-2f4f5ff71c5b tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0ee9fb07-0cc5-4689-a298-2f4f5ff71c5b tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0ee9fb07-0cc5-4689-a298-2f4f5ff71c5b tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0ee9fb07-0cc5-4689-a298-2f4f5ff71c5b tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:07 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-0ee9fb07-0cc5-4689-a298-2f4f5ff71c5b tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] HTTP exception thrown: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. Apr 12 10:39:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-0ee9fb07-0cc5-4689-a298-2f4f5ff71c5b tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Request method failure captured: Apr 12 10:39:07 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3 HTTP/1.1 Apr 12 10:39:07 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:39:07 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:39:07 user devstack@n-api.service[61852]: Connection: close Apr 12 10:39:07 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:39:07 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:39:07 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:39:07 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:39:07 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:39:07 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNolj0u_TGTQ98P41e8rNAwIVzEqripLicMesoooadQuXD48axqsd3d6HoE0R4tJKaai-RF2oHx379l_8BTtyODN6n9zY-TA0_0R0EB4GucSrwLFCTdnYZeyXH69PyvcPeJaBLfhWFgsLJ5WHZ64PFz1--kBeKiYujm46n4gh71VNBlM Apr 12 10:39:07 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:39:07 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:39:07 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:39:07 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:39:07 user devstack@n-api.service[61852]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 10:39:07 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:39:07 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:39:07 user devstack@n-api.service[61852]: X-Project-Id: 1fcfbd94249342b2a436d2592e0dc9bf Apr 12 10:39:07 user devstack@n-api.service[61852]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-639083036 Apr 12 10:39:07 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:39:07 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:39:07 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1fcfbd94249342b2a436d2592e0dc9bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fcfbd94249342b2a436d2592e0dc9bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fcfbd94249342b2a436d2592e0dc9bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:39:07 user devstack@n-api.service[61852]: X-Tenant: tempest-TaggedBootDevicesTest_v242-639083036 Apr 12 10:39:07 user devstack@n-api.service[61852]: X-Tenant-Id: 1fcfbd94249342b2a436d2592e0dc9bf Apr 12 10:39:07 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-639083036 Apr 12 10:39:07 user devstack@n-api.service[61852]: X-User: tempest-TaggedBootDevicesTest_v242-639083036-project-member Apr 12 10:39:07 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:39:07 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:39:07 user devstack@n-api.service[61852]: X-User-Id: 949ebef2d45b4d64a89a11d837dfffd3 Apr 12 10:39:07 user devstack@n-api.service[61852]: X-User-Name: tempest-TaggedBootDevicesTest_v242-639083036-project-member Apr 12 10:39:07 user devstack@n-api.service[61852]: method: > Apr 12 10:39:07 user devstack@n-api.service[61852]: exception: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. Apr 12 10:39:07 user devstack@n-api.service[61852]: action_args: {'id': 'b9fd76e3-c7ed-4631-b056-3bd13439f7d3'} Apr 12 10:39:07 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. Apr 12 10:39:07 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:39:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-0ee9fb07-0cc5-4689-a298-2f4f5ff71c5b tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Returning 404 to user: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:39:07 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-0ee9fb07-0cc5-4689-a298-2f4f5ff71c5b tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3" status: 404 len: 111 microversion: 2.42 time: 0.029039 Apr 12 10:39:07 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 91/276] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:39:07 2023] GET /compute/v2.1/servers/b9fd76e3-c7ed-4631-b056-3bd13439f7d3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:39:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-09673848-046f-44fa-901a-2ca5dcf7b981 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:11 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-09673848-046f-44fa-901a-2ca5dcf7b981 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:11 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:39:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-09673848-046f-44fa-901a-2ca5dcf7b981 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-09673848-046f-44fa-901a-2ca5dcf7b981 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-09673848-046f-44fa-901a-2ca5dcf7b981 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-09673848-046f-44fa-901a-2ca5dcf7b981 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-09673848-046f-44fa-901a-2ca5dcf7b981 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-09673848-046f-44fa-901a-2ca5dcf7b981 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:11 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=31 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:39:11 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-09673848-046f-44fa-901a-2ca5dcf7b981 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c757f04065b9488ba75739e59d7be377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce2a3bde13e464f8df0a41f30c240ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-09673848-046f-44fa-901a-2ca5dcf7b981 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5" status: 200 len: 1671 microversion: 2.1 time: 0.217144 Apr 12 10:39:11 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 96/277] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:39:11 2023] GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5 => generated 1671 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:39:12 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afb7485e-496d-4fb9-a5b1-613d21171666"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:12 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:12 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:39:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:13 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-0e449869-d326-4b8a-a8ff-854e97adb253 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:13 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-0e449869-d326-4b8a-a8ff-854e97adb253 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:13 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:39:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0e449869-d326-4b8a-a8ff-854e97adb253 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0e449869-d326-4b8a-a8ff-854e97adb253 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0e449869-d326-4b8a-a8ff-854e97adb253 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0e449869-d326-4b8a-a8ff-854e97adb253 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0e449869-d326-4b8a-a8ff-854e97adb253 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0e449869-d326-4b8a-a8ff-854e97adb253 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:13 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=25 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:39:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325667 Apr 12 10:39:13 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 91/278] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:39:12 2023] POST /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:39:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0db72a1a-0bf9-43b1-b7d9-afdf01e064a5 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:13 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-0db72a1a-0bf9-43b1-b7d9-afdf01e064a5 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0db72a1a-0bf9-43b1-b7d9-afdf01e064a5 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0db72a1a-0bf9-43b1-b7d9-afdf01e064a5 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0db72a1a-0bf9-43b1-b7d9-afdf01e064a5 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0db72a1a-0bf9-43b1-b7d9-afdf01e064a5 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0db72a1a-0bf9-43b1-b7d9-afdf01e064a5 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0db72a1a-0bf9-43b1-b7d9-afdf01e064a5 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-0db72a1a-0bf9-43b1-b7d9-afdf01e064a5 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054592 Apr 12 10:39:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 97/279] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:39:13 2023] GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 10:39:13 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-0e449869-d326-4b8a-a8ff-854e97adb253 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:13 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-0e449869-d326-4b8a-a8ff-854e97adb253 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:13 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-0e449869-d326-4b8a-a8ff-854e97adb253 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:13 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-0e449869-d326-4b8a-a8ff-854e97adb253 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" status: 200 len: 1767 microversion: 2.87 time: 0.353221 Apr 12 10:39:13 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 92/280] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:39:12 2023] GET /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 => generated 1767 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:39:13 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:13 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:13 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:39:13 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:39:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb" status: 204 len: 0 microversion: 2.1 time: 0.161492 Apr 12 10:39:13 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 92/281] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:39:13 2023] DELETE /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:39:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a281af93-ffb9-4e30-ba01-547cde57e032 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:13 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a281af93-ffb9-4e30-ba01-547cde57e032 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a281af93-ffb9-4e30-ba01-547cde57e032 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a281af93-ffb9-4e30-ba01-547cde57e032 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a281af93-ffb9-4e30-ba01-547cde57e032 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a281af93-ffb9-4e30-ba01-547cde57e032 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a281af93-ffb9-4e30-ba01-547cde57e032 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a281af93-ffb9-4e30-ba01-547cde57e032 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:13 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-a281af93-ffb9-4e30-ba01-547cde57e032 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80dbdeaccf84466286a6d85921e15a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b7b715cc24490ebd04d5469b6e07ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a281af93-ffb9-4e30-ba01-547cde57e032 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb" status: 200 len: 1651 microversion: 2.1 time: 0.261667 Apr 12 10:39:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 98/282] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:39:13 2023] GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb => generated 1651 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:39:13 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-898ecbc3-95a5-4417-a820-2f582ff61485 req-828bb410-dda9-457f-8563-8f3c7a52e451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea55f551-968e-4ece-a37a-c4128ce5e8cb", "name": "network-vif-unplugged", "status": "completed", "tag": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:13 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1a611fbb-5f54-4341-aa1c-c8623ca9bf69 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:13 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-1a611fbb-5f54-4341-aa1c-c8623ca9bf69 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-898ecbc3-95a5-4417-a820-2f582ff61485 req-828bb410-dda9-457f-8563-8f3c7a52e451 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-898ecbc3-95a5-4417-a820-2f582ff61485 req-828bb410-dda9-457f-8563-8f3c7a52e451 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-898ecbc3-95a5-4417-a820-2f582ff61485 req-828bb410-dda9-457f-8563-8f3c7a52e451 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1a611fbb-5f54-4341-aa1c-c8623ca9bf69 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1a611fbb-5f54-4341-aa1c-c8623ca9bf69 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1a611fbb-5f54-4341-aa1c-c8623ca9bf69 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1a611fbb-5f54-4341-aa1c-c8623ca9bf69 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1a611fbb-5f54-4341-aa1c-c8623ca9bf69 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1a611fbb-5f54-4341-aa1c-c8623ca9bf69 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:13 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-898ecbc3-95a5-4417-a820-2f582ff61485 req-828bb410-dda9-457f-8563-8f3c7a52e451 service nova] Creating event network-vif-unplugged:9d4bc0b7-4a2b-4354-a609-c673f6235cc7 for instance ea55f551-968e-4ece-a37a-c4128ce5e8cb on user Apr 12 10:39:13 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-898ecbc3-95a5-4417-a820-2f582ff61485 req-828bb410-dda9-457f-8563-8f3c7a52e451 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034101 Apr 12 10:39:13 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 93/283] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:39:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:39:14 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-1a611fbb-5f54-4341-aa1c-c8623ca9bf69 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1a611fbb-5f54-4341-aa1c-c8623ca9bf69 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1658 microversion: 2.1 time: 0.303157 Apr 12 10:39:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 93/284] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:39:13 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1658 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:39:14 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "028bc65f-dc6d-4486-a99f-19a5ae874a93"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:14 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:14 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:14 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:14 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:39:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/893c42b2-83ed-4823-9698-2015a3ffd4c5" status: 204 len: 0 microversion: 2.1 time: 0.156551 Apr 12 10:39:14 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 94/285] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:39:14 2023] DELETE /compute/v2.1/servers/893c42b2-83ed-4823-9698-2015a3ffd4c5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:39:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7fc413ee-75bc-4df7-a0f4-84b8ecd39d60 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:14 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-7fc413ee-75bc-4df7-a0f4-84b8ecd39d60 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7fc413ee-75bc-4df7-a0f4-84b8ecd39d60 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7fc413ee-75bc-4df7-a0f4-84b8ecd39d60 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7fc413ee-75bc-4df7-a0f4-84b8ecd39d60 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7fc413ee-75bc-4df7-a0f4-84b8ecd39d60 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7fc413ee-75bc-4df7-a0f4-84b8ecd39d60 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7fc413ee-75bc-4df7-a0f4-84b8ecd39d60 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.404027 Apr 12 10:39:14 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 99/286] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:39:14 2023] POST /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/os-volume_attachments => generated 194 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:39:14 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-294c70f8-55d7-43f2-883b-92e528627e30 req-c37a8891-6368-4da4-8805-eb97439ab35a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893c42b2-83ed-4823-9698-2015a3ffd4c5", "name": "network-vif-unplugged", "status": "completed", "tag": "92cfa1bd-511c-4432-8b37-529eb34f8b21"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-294c70f8-55d7-43f2-883b-92e528627e30 req-c37a8891-6368-4da4-8805-eb97439ab35a service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-294c70f8-55d7-43f2-883b-92e528627e30 req-c37a8891-6368-4da4-8805-eb97439ab35a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-294c70f8-55d7-43f2-883b-92e528627e30 req-c37a8891-6368-4da4-8805-eb97439ab35a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-294c70f8-55d7-43f2-883b-92e528627e30 req-c37a8891-6368-4da4-8805-eb97439ab35a service nova] Creating event network-vif-unplugged:92cfa1bd-511c-4432-8b37-529eb34f8b21 for instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 on user Apr 12 10:39:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-294c70f8-55d7-43f2-883b-92e528627e30 req-c37a8891-6368-4da4-8805-eb97439ab35a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033153 Apr 12 10:39:14 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 95/287] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:39:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:39:14 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-7fc413ee-75bc-4df7-a0f4-84b8ecd39d60 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d19bfc4894401cb664521438338b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024682bfda5548b8b9b404c85dd55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-7fc413ee-75bc-4df7-a0f4-84b8ecd39d60 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/893c42b2-83ed-4823-9698-2015a3ffd4c5" status: 200 len: 1497 microversion: 2.1 time: 0.457832 Apr 12 10:39:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 94/288] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:39:14 2023] GET /compute/v2.1/servers/893c42b2-83ed-4823-9698-2015a3ffd4c5 => generated 1497 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:39:15 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-51855656-5cbf-4dce-90ad-96283b6158f1 req-3f460c1c-1662-496a-a0f2-21f019de6695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea55f551-968e-4ece-a37a-c4128ce5e8cb", "name": "network-vif-plugged", "status": "completed", "tag": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-51855656-5cbf-4dce-90ad-96283b6158f1 req-3f460c1c-1662-496a-a0f2-21f019de6695 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-51855656-5cbf-4dce-90ad-96283b6158f1 req-3f460c1c-1662-496a-a0f2-21f019de6695 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-51855656-5cbf-4dce-90ad-96283b6158f1 req-3f460c1c-1662-496a-a0f2-21f019de6695 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:15 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-51855656-5cbf-4dce-90ad-96283b6158f1 req-3f460c1c-1662-496a-a0f2-21f019de6695 service nova] Creating event network-vif-plugged:9d4bc0b7-4a2b-4354-a609-c673f6235cc7 for instance ea55f551-968e-4ece-a37a-c4128ce5e8cb on user Apr 12 10:39:15 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-51855656-5cbf-4dce-90ad-96283b6158f1 req-3f460c1c-1662-496a-a0f2-21f019de6695 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032866 Apr 12 10:39:15 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 100/289] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:39:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:39:16 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-3e30dd2a-9f48-488d-b8fd-9e8933f1876d req-4489cf82-3ba4-4eb6-b469-1b01774f0660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea55f551-968e-4ece-a37a-c4128ce5e8cb", "name": "network-vif-deleted", "tag": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:16 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-3e30dd2a-9f48-488d-b8fd-9e8933f1876d req-4489cf82-3ba4-4eb6-b469-1b01774f0660 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:16 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-3e30dd2a-9f48-488d-b8fd-9e8933f1876d req-4489cf82-3ba4-4eb6-b469-1b01774f0660 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:16 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-3e30dd2a-9f48-488d-b8fd-9e8933f1876d req-4489cf82-3ba4-4eb6-b469-1b01774f0660 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:16 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-3e30dd2a-9f48-488d-b8fd-9e8933f1876d req-4489cf82-3ba4-4eb6-b469-1b01774f0660 service nova] Creating event network-vif-deleted:9d4bc0b7-4a2b-4354-a609-c673f6235cc7 for instance ea55f551-968e-4ece-a37a-c4128ce5e8cb on user Apr 12 10:39:16 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-3e30dd2a-9f48-488d-b8fd-9e8933f1876d req-4489cf82-3ba4-4eb6-b469-1b01774f0660 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031592 Apr 12 10:39:16 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 96/290] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:39:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:39:16 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-f7833003-8d16-450e-aea6-c8d5bafaf50e req-b862ce14-5203-4a1a-888a-31c84ec93df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893c42b2-83ed-4823-9698-2015a3ffd4c5", "name": "network-vif-plugged", "status": "completed", "tag": "92cfa1bd-511c-4432-8b37-529eb34f8b21"}, {"server_uuid": "893c42b2-83ed-4823-9698-2015a3ffd4c5", "name": "network-vif-deleted", "tag": "92cfa1bd-511c-4432-8b37-529eb34f8b21"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f7833003-8d16-450e-aea6-c8d5bafaf50e req-b862ce14-5203-4a1a-888a-31c84ec93df0 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f7833003-8d16-450e-aea6-c8d5bafaf50e req-b862ce14-5203-4a1a-888a-31c84ec93df0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f7833003-8d16-450e-aea6-c8d5bafaf50e req-b862ce14-5203-4a1a-888a-31c84ec93df0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:16 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-f7833003-8d16-450e-aea6-c8d5bafaf50e req-b862ce14-5203-4a1a-888a-31c84ec93df0 service nova] Creating event network-vif-plugged:92cfa1bd-511c-4432-8b37-529eb34f8b21 for instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 on user Apr 12 10:39:16 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-f7833003-8d16-450e-aea6-c8d5bafaf50e req-b862ce14-5203-4a1a-888a-31c84ec93df0 service nova] Creating event network-vif-deleted:92cfa1bd-511c-4432-8b37-529eb34f8b21 for instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 on user Apr 12 10:39:16 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-f7833003-8d16-450e-aea6-c8d5bafaf50e req-b862ce14-5203-4a1a-888a-31c84ec93df0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044604 Apr 12 10:39:16 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 95/291] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:39:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:39:21 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "f4fcf2fb-8011-4377-96b3-cd19c43f5545"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:21 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:21 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lazy-loading 'flavor' on Instance uuid f47d368e-3870-49d0-8522-a94991ec4ba5 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:39:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5/action" status: 200 len: 29 microversion: 2.1 time: 0.373008 Apr 12 10:39:22 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 101/292] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:39:21 2023] POST /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5/action => generated 29 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 10:39:22 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-b814a7f8-cf47-4324-a9fc-b0d0003470f9 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:22 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-b814a7f8-cf47-4324-a9fc-b0d0003470f9 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b814a7f8-cf47-4324-a9fc-b0d0003470f9 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b814a7f8-cf47-4324-a9fc-b0d0003470f9 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b814a7f8-cf47-4324-a9fc-b0d0003470f9 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b814a7f8-cf47-4324-a9fc-b0d0003470f9 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b814a7f8-cf47-4324-a9fc-b0d0003470f9 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b814a7f8-cf47-4324-a9fc-b0d0003470f9 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-6fa8bae6-3105-4796-b02e-63a523064dca tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:22 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-6fa8bae6-3105-4796-b02e-63a523064dca tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6fa8bae6-3105-4796-b02e-63a523064dca tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6fa8bae6-3105-4796-b02e-63a523064dca tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6fa8bae6-3105-4796-b02e-63a523064dca tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6fa8bae6-3105-4796-b02e-63a523064dca tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6fa8bae6-3105-4796-b02e-63a523064dca tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6fa8bae6-3105-4796-b02e-63a523064dca tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:22 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-b814a7f8-cf47-4324-a9fc-b0d0003470f9 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c757f04065b9488ba75739e59d7be377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce2a3bde13e464f8df0a41f30c240ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:22 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-b814a7f8-cf47-4324-a9fc-b0d0003470f9 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5" status: 200 len: 1723 microversion: 2.1 time: 0.165029 Apr 12 10:39:22 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 97/293] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:39:22 2023] GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 10:39:22 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-6fa8bae6-3105-4796-b02e-63a523064dca tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-6fa8bae6-3105-4796-b02e-63a523064dca tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1704 microversion: 2.1 time: 0.456497 Apr 12 10:39:22 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 96/294] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:39:22 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1704 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:39:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-1970085629", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:22 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:22 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting quotas for project 32235c67d269474b879a58269c1bfb28. Resources: dict_keys(['metadata_items']) {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:39:22 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting quotas for user 0059d31539304ffcb5214b408751cd4f and project 32235c67d269474b879a58269c1bfb28. Resources: dict_keys(['metadata_items']) {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:39:22 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:39:22 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:39:22 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:39:22 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:39:22 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:39:23 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/action" status: 202 len: 1159 microversion: 2.1 time: 0.408541 Apr 12 10:39:23 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 102/295] 10.0.0.210 () {64 vars in 1356 bytes} [Wed Apr 12 10:39:22 2023] POST /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/action => generated 1159 bytes in 410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 10:39:23 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-f55253e7-e9f0-4b2a-8602-019d6a373e94 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:23 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-f55253e7-e9f0-4b2a-8602-019d6a373e94 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f55253e7-e9f0-4b2a-8602-019d6a373e94 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f55253e7-e9f0-4b2a-8602-019d6a373e94 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f55253e7-e9f0-4b2a-8602-019d6a373e94 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f55253e7-e9f0-4b2a-8602-019d6a373e94 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f55253e7-e9f0-4b2a-8602-019d6a373e94 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f55253e7-e9f0-4b2a-8602-019d6a373e94 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:23 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-f55253e7-e9f0-4b2a-8602-019d6a373e94 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:23 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-f55253e7-e9f0-4b2a-8602-019d6a373e94 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1732 microversion: 2.1 time: 0.220810 Apr 12 10:39:23 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 98/296] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:39:23 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1732 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:39:23 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-a22f893c-c8a9-40a0-b585-ae24bbfe97ee req-6085d870-b7c6-41bc-b396-d1532e8508ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47d368e-3870-49d0-8522-a94991ec4ba5", "name": "network-vif-unplugged", "status": "completed", "tag": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a22f893c-c8a9-40a0-b585-ae24bbfe97ee req-6085d870-b7c6-41bc-b396-d1532e8508ce service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a22f893c-c8a9-40a0-b585-ae24bbfe97ee req-6085d870-b7c6-41bc-b396-d1532e8508ce service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a22f893c-c8a9-40a0-b585-ae24bbfe97ee req-6085d870-b7c6-41bc-b396-d1532e8508ce service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-a22f893c-c8a9-40a0-b585-ae24bbfe97ee req-6085d870-b7c6-41bc-b396-d1532e8508ce service nova] Creating event network-vif-unplugged:7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance f47d368e-3870-49d0-8522-a94991ec4ba5 on user Apr 12 10:39:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-a22f893c-c8a9-40a0-b585-ae24bbfe97ee req-6085d870-b7c6-41bc-b396-d1532e8508ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045369 Apr 12 10:39:23 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 97/297] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:39:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:39:25 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47d368e-3870-49d0-8522-a94991ec4ba5", "name": "network-vif-plugged", "status": "completed", "tag": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c"}, {"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-unplugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}, {"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-plugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}, {"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-plugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}, {"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-plugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}, {"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-unplugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}, {"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-plugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Creating event network-vif-plugged:7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance f47d368e-3870-49d0-8522-a94991ec4ba5 on user Apr 12 10:39:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Creating event network-vif-unplugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:39:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Creating event network-vif-plugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:39:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Creating event network-vif-plugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:39:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Creating event network-vif-plugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:39:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Creating event network-vif-unplugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:39:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Creating event network-vif-plugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:39:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1213 microversion: 2.1 time: 0.077979 Apr 12 10:39:25 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 103/298] 10.0.0.210 () {68 vars in 1395 bytes} [Wed Apr 12 10:39:25 2023] POST /compute/v2.1/os-server-external-events => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:39:28 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-e9f33cdb-75f7-4862-ab22-492123f56dff req-c69101e1-4996-42c7-ab39-405ff653512a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47d368e-3870-49d0-8522-a94991ec4ba5", "name": "network-vif-plugged", "status": "completed", "tag": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e9f33cdb-75f7-4862-ab22-492123f56dff req-c69101e1-4996-42c7-ab39-405ff653512a service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e9f33cdb-75f7-4862-ab22-492123f56dff req-c69101e1-4996-42c7-ab39-405ff653512a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e9f33cdb-75f7-4862-ab22-492123f56dff req-c69101e1-4996-42c7-ab39-405ff653512a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:28 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-e9f33cdb-75f7-4862-ab22-492123f56dff req-c69101e1-4996-42c7-ab39-405ff653512a service nova] Creating event network-vif-plugged:7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance f47d368e-3870-49d0-8522-a94991ec4ba5 on user Apr 12 10:39:28 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-e9f33cdb-75f7-4862-ab22-492123f56dff req-c69101e1-4996-42c7-ab39-405ff653512a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033932 Apr 12 10:39:28 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 99/299] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:39:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:39:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-cdffacea-4597-4ca9-a053-e962531be73e req-41695e35-6648-4f70-b654-b09e364131f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47d368e-3870-49d0-8522-a94991ec4ba5", "name": "network-vif-plugged", "status": "completed", "tag": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cdffacea-4597-4ca9-a053-e962531be73e req-41695e35-6648-4f70-b654-b09e364131f4 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cdffacea-4597-4ca9-a053-e962531be73e req-41695e35-6648-4f70-b654-b09e364131f4 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cdffacea-4597-4ca9-a053-e962531be73e req-41695e35-6648-4f70-b654-b09e364131f4 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-cdffacea-4597-4ca9-a053-e962531be73e req-41695e35-6648-4f70-b654-b09e364131f4 service nova] Creating event network-vif-plugged:7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance f47d368e-3870-49d0-8522-a94991ec4ba5 on user Apr 12 10:39:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-cdffacea-4597-4ca9-a053-e962531be73e req-41695e35-6648-4f70-b654-b09e364131f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068249 Apr 12 10:39:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 98/300] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:39:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:39:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a17815ee-06c4-4871-8793-0719b914911e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:31 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a17815ee-06c4-4871-8793-0719b914911e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a17815ee-06c4-4871-8793-0719b914911e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a17815ee-06c4-4871-8793-0719b914911e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a17815ee-06c4-4871-8793-0719b914911e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a17815ee-06c4-4871-8793-0719b914911e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a17815ee-06c4-4871-8793-0719b914911e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a17815ee-06c4-4871-8793-0719b914911e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:31 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-a17815ee-06c4-4871-8793-0719b914911e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:31 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-a17815ee-06c4-4871-8793-0719b914911e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:31 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-a17815ee-06c4-4871-8793-0719b914911e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a17815ee-06c4-4871-8793-0719b914911e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa" status: 200 len: 1586 microversion: 2.20 time: 0.193585 Apr 12 10:39:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 104/301] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:39:31 2023] GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa => generated 1586 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:39:33 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-cd20e373-a22e-4db7-8c26-557bed497419 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Action: 'create', calling method: .version_select at 0x7fabbf86f760>, body: {"keypair": {"name": "tempest-keypair-1587791170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg=="}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:33 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-cd20e373-a22e-4db7-8c26-557bed497419 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Getting quotas for project f1ec9852adb94a5086dc3ef48871d5bc. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:39:33 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-cd20e373-a22e-4db7-8c26-557bed497419 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Getting quotas for user 21034326c41f487181d19f60e0ccf219 and project f1ec9852adb94a5086dc3ef48871d5bc. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:39:33 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-cd20e373-a22e-4db7-8c26-557bed497419 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.050463 Apr 12 10:39:33 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 100/302] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 10:39:33 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 10:39:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-231402709", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "698d4aee-44be-48ca-ab9b-0d58aed34d96"}, {"port": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "tag": "port-1"}, {"port": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "tag": "port-2"}, {"uuid": "26d4148b-d50a-44e3-8b4b-5673f0395785", "tag": "net-1"}, {"uuid": "26d4148b-d50a-44e3-8b4b-5673f0395785"}, {"uuid": "91288215-145e-4cd6-953e-edb9f28d5c84", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "91288215-145e-4cd6-953e-edb9f28d5c84", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b76b2ba5-6ae0-4392-9b42-e06b4a967ac7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "df938975-a760-4947-97c7-9d557f068c75", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "a5d2f824-dd5b-4306-a67e-2a7aeda984a2", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1140238912"}], "key_name": "tempest-keypair-1587791170", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:34 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] validate_networks() for [('698d4aee-44be-48ca-ab9b-0d58aed34d96', None, None, None, None, None), (None, None, 'bbbdccd3-ba1c-46e2-90b5-10d6036f72c7', None, None, None), (None, None, 'e16e56f7-00ab-422d-95b3-d1b204f693a3', None, None, None), ('26d4148b-d50a-44e3-8b4b-5673f0395785', None, None, None, None, None), ('26d4148b-d50a-44e3-8b4b-5673f0395785', None, None, None, None, None), ('91288215-145e-4cd6-953e-edb9f28d5c84', '10.2.2.100', None, None, None, None), ('91288215-145e-4cd6-953e-edb9f28d5c84', '10.2.2.200', None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:39:36 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-009ed947-a789-439f-ad8d-f636565e3f30 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:36 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-009ed947-a789-439f-ad8d-f636565e3f30 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-009ed947-a789-439f-ad8d-f636565e3f30 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-009ed947-a789-439f-ad8d-f636565e3f30 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-009ed947-a789-439f-ad8d-f636565e3f30 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-009ed947-a789-439f-ad8d-f636565e3f30 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-009ed947-a789-439f-ad8d-f636565e3f30 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-009ed947-a789-439f-ad8d-f636565e3f30 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:36 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-655ae0fc-1478-4091-9a0a-44b2d38b2de9 req-33660855-5199-486a-ac42-de6e88ec6315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-plugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-655ae0fc-1478-4091-9a0a-44b2d38b2de9 req-33660855-5199-486a-ac42-de6e88ec6315 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-655ae0fc-1478-4091-9a0a-44b2d38b2de9 req-33660855-5199-486a-ac42-de6e88ec6315 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-655ae0fc-1478-4091-9a0a-44b2d38b2de9 req-33660855-5199-486a-ac42-de6e88ec6315 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:36 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-655ae0fc-1478-4091-9a0a-44b2d38b2de9 req-33660855-5199-486a-ac42-de6e88ec6315 service nova] Creating event network-vif-plugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:39:36 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-655ae0fc-1478-4091-9a0a-44b2d38b2de9 req-33660855-5199-486a-ac42-de6e88ec6315 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050537 Apr 12 10:39:36 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 101/303] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:39:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:39:36 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-009ed947-a789-439f-ad8d-f636565e3f30 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a2243c6c9f431da846cc54ec181fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb8217b1544db384bebe1059848bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:36 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=8,nova_cell1:INSERT=4,nova_cell1:DELETE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:39:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-009ed947-a789-439f-ad8d-f636565e3f30 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c663163-6794-4c92-a401-5bc15d112c65" status: 200 len: 1494 microversion: 2.1 time: 0.199111 Apr 12 10:39:36 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 105/304] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:39:36 2023] GET /compute/v2.1/servers/1c663163-6794-4c92-a401-5bc15d112c65 => generated 1494 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:39:37 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:39:37 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:39:37 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:39:37 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:39:37 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:39:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:37 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Getting quotas for project f1ec9852adb94a5086dc3ef48871d5bc. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:39:37 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Getting quotas for user 21034326c41f487181d19f60e0ccf219 and project f1ec9852adb94a5086dc3ef48871d5bc. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:39:37 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:39:37 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b76b2ba5-6ae0-4392-9b42-e06b4a967ac7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='df938975-a760-4947-97c7-9d557f068c75',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a5d2f824-dd5b-4306-a67e-2a7aeda984a2',volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:39:38 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 3.225331 Apr 12 10:39:38 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 99/305] 10.0.0.210 () {66 vars in 1266 bytes} [Wed Apr 12 10:39:34 2023] POST /compute/v2.1/servers => generated 404 bytes in 3227 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 10:39:38 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-b97cd472-edb9-4937-afb8-d17adc7a5450 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:38 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-b97cd472-edb9-4937-afb8-d17adc7a5450 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:38 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-b97cd472-edb9-4937-afb8-d17adc7a5450 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21034326c41f487181d19f60e0ccf219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ec9852adb94a5086dc3ef48871d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:38 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-b97cd472-edb9-4937-afb8-d17adc7a5450 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21034326c41f487181d19f60e0ccf219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ec9852adb94a5086dc3ef48871d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:38 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-b97cd472-edb9-4937-afb8-d17adc7a5450 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21034326c41f487181d19f60e0ccf219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ec9852adb94a5086dc3ef48871d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:39:38 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-b97cd472-edb9-4937-afb8-d17adc7a5450 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8" status: 200 len: 1279 microversion: 2.32 time: 0.077445 Apr 12 10:39:38 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 102/306] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:39:38 2023] GET /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8 => generated 1279 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:39:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-c35721e2-a1ba-4625-bd4b-df740862a551 req-114977db-a4ca-4cce-a999-4e599fa01444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-plugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c35721e2-a1ba-4625-bd4b-df740862a551 req-114977db-a4ca-4cce-a999-4e599fa01444 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c35721e2-a1ba-4625-bd4b-df740862a551 req-114977db-a4ca-4cce-a999-4e599fa01444 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c35721e2-a1ba-4625-bd4b-df740862a551 req-114977db-a4ca-4cce-a999-4e599fa01444 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-c35721e2-a1ba-4625-bd4b-df740862a551 req-114977db-a4ca-4cce-a999-4e599fa01444 service nova] Creating event network-vif-plugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:39:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-c35721e2-a1ba-4625-bd4b-df740862a551 req-114977db-a4ca-4cce-a999-4e599fa01444 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051833 Apr 12 10:39:38 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 106/307] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:39:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:39:44 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-3ce963ef-c045-4727-afb4-58031e8911e9 req-8d837a34-2905-4c1a-82b9-c1cd7a453ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "tag": "daf1aa56-7b24-4f41-93fd-a54cdf96428f"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:44 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:39:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3ce963ef-c045-4727-afb4-58031e8911e9 req-8d837a34-2905-4c1a-82b9-c1cd7a453ce3 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3ce963ef-c045-4727-afb4-58031e8911e9 req-8d837a34-2905-4c1a-82b9-c1cd7a453ce3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3ce963ef-c045-4727-afb4-58031e8911e9 req-8d837a34-2905-4c1a-82b9-c1cd7a453ce3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:44 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:39:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-3ce963ef-c045-4727-afb4-58031e8911e9 req-8d837a34-2905-4c1a-82b9-c1cd7a453ce3 service nova] Creating event network-changed:daf1aa56-7b24-4f41-93fd-a54cdf96428f for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:39:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-3ce963ef-c045-4727-afb4-58031e8911e9 req-8d837a34-2905-4c1a-82b9-c1cd7a453ce3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046252 Apr 12 10:39:44 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 100/308] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:39:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:39:46 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "tag": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7"}, {"name": "network-changed", "server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "tag": "e16e56f7-00ab-422d-95b3-d1b204f693a3"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:46 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:39:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:46 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:39:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] Creating event network-changed:bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:39:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] Creating event network-changed:e16e56f7-00ab-422d-95b3-d1b204f693a3 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:39:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034645 Apr 12 10:39:46 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 103/309] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:39:46 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:39:48 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "tag": "fb79e431-1d99-40eb-94a0-20032fa213fb"}, {"name": "network-changed", "server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "tag": "825c6036-d16c-43ab-9f6a-2bb133bf51b8"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:48 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=34 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:39:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:48 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] Creating event network-changed:fb79e431-1d99-40eb-94a0-20032fa213fb for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:39:48 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] Creating event network-changed:825c6036-d16c-43ab-9f6a-2bb133bf51b8 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:39:48 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.064737 Apr 12 10:39:48 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 107/310] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:39:48 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:39:50 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:39:50 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:39:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "tag": "13923b13-db35-4b98-b2b0-e2e18fd8441e"}, {"name": "network-changed", "server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "tag": "3c8cf480-05d6-463a-a97e-a9d869ac3860"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] Creating event network-changed:13923b13-db35-4b98-b2b0-e2e18fd8441e for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:39:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] Creating event network-changed:3c8cf480-05d6-463a-a97e-a9d869ac3860 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:39:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038581 Apr 12 10:39:50 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 101/311] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:39:50 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:39:51 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:39:51 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-a5f68566-6a54-444e-ba60-67e6e387bb75 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:51 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-a5f68566-6a54-444e-ba60-67e6e387bb75 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:51 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a5f68566-6a54-444e-ba60-67e6e387bb75 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:51 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a5f68566-6a54-444e-ba60-67e6e387bb75 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:51 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a5f68566-6a54-444e-ba60-67e6e387bb75 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:51 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a5f68566-6a54-444e-ba60-67e6e387bb75 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:51 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a5f68566-6a54-444e-ba60-67e6e387bb75 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:51 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a5f68566-6a54-444e-ba60-67e6e387bb75 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:51 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-a5f68566-6a54-444e-ba60-67e6e387bb75 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] HTTP exception thrown: Instance f147b4ee-d130-41ae-a4db-bc248fb23266 could not be found. Apr 12 10:39:51 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-a5f68566-6a54-444e-ba60-67e6e387bb75 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Request method failure captured: Apr 12 10:39:51 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266 HTTP/1.1 Apr 12 10:39:51 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:39:51 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:39:51 user devstack@n-api.service[61852]: Connection: close Apr 12 10:39:51 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:39:51 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:39:51 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:39:51 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:39:51 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:39:51 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNolw_nYryFICsBs3LElhFE6paVxZf-iI0P3xbWrRbeaU25Lf5iwn-zPOW90w3Ix0basj9ly2ny_regvUP1VHGHvPqpdyFxpQRdzgwcCaXHkA7g6GiMMZUvTc7zxTi20Dun7VZ1OFiF6ozQXIq1ETPvxfzUeOW7MadsviWSySFOKZZ1k Apr 12 10:39:51 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:39:51 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:39:51 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:39:51 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:39:51 user devstack@n-api.service[61852]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 10:39:51 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:39:51 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:39:51 user devstack@n-api.service[61852]: X-Project-Id: 6981486a29b64ee7b9ef7cbf2ca852be Apr 12 10:39:51 user devstack@n-api.service[61852]: X-Project-Name: tempest-TaggedAttachmentsTest-2008645939 Apr 12 10:39:51 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:39:51 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:39:51 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6981486a29b64ee7b9ef7cbf2ca852be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6981486a29b64ee7b9ef7cbf2ca852be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6981486a29b64ee7b9ef7cbf2ca852be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:39:51 user devstack@n-api.service[61852]: X-Tenant: tempest-TaggedAttachmentsTest-2008645939 Apr 12 10:39:51 user devstack@n-api.service[61852]: X-Tenant-Id: 6981486a29b64ee7b9ef7cbf2ca852be Apr 12 10:39:51 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-TaggedAttachmentsTest-2008645939 Apr 12 10:39:51 user devstack@n-api.service[61852]: X-User: tempest-TaggedAttachmentsTest-2008645939-project-member Apr 12 10:39:51 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:39:51 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:39:51 user devstack@n-api.service[61852]: X-User-Id: 254d3560065c4d8a8aaf312870be2967 Apr 12 10:39:51 user devstack@n-api.service[61852]: X-User-Name: tempest-TaggedAttachmentsTest-2008645939-project-member Apr 12 10:39:51 user devstack@n-api.service[61852]: method: > Apr 12 10:39:51 user devstack@n-api.service[61852]: exception: Instance f147b4ee-d130-41ae-a4db-bc248fb23266 could not be found. Apr 12 10:39:51 user devstack@n-api.service[61852]: action_args: {'id': 'f147b4ee-d130-41ae-a4db-bc248fb23266'} Apr 12 10:39:51 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f147b4ee-d130-41ae-a4db-bc248fb23266 could not be found. Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f147b4ee-d130-41ae-a4db-bc248fb23266 could not be found. Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f147b4ee-d130-41ae-a4db-bc248fb23266 could not be found. Apr 12 10:39:51 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:39:51 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-a5f68566-6a54-444e-ba60-67e6e387bb75 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Returning 404 to user: Instance f147b4ee-d130-41ae-a4db-bc248fb23266 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:39:51 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-a5f68566-6a54-444e-ba60-67e6e387bb75 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266" status: 404 len: 111 microversion: 2.49 time: 0.029556 Apr 12 10:39:51 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 104/312] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:39:51 2023] GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:39:51 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-770ddca2-a976-48a8-a901-363eb1291a25 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Calling method '.version_select at 0x7fabbf8bedd0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:51 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-770ddca2-a976-48a8-a901-363eb1291a25 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041772862" status: 204 len: 0 microversion: 2.49 time: 0.021531 Apr 12 10:39:51 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 108/313] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 10:39:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041772862 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 10:39:53 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-eb149bd3-e063-4384-b029-2fa40603fabc tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:53 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-eb149bd3-e063-4384-b029-2fa40603fabc tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eb149bd3-e063-4384-b029-2fa40603fabc tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eb149bd3-e063-4384-b029-2fa40603fabc tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eb149bd3-e063-4384-b029-2fa40603fabc tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eb149bd3-e063-4384-b029-2fa40603fabc tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eb149bd3-e063-4384-b029-2fa40603fabc tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-eb149bd3-e063-4384-b029-2fa40603fabc tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:53 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-eb149bd3-e063-4384-b029-2fa40603fabc tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] HTTP exception thrown: Instance f147b4ee-d130-41ae-a4db-bc248fb23266 could not be found. Apr 12 10:39:53 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-eb149bd3-e063-4384-b029-2fa40603fabc tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Request method failure captured: Apr 12 10:39:53 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266 HTTP/1.1 Apr 12 10:39:53 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:39:53 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:39:53 user devstack@n-api.service[61853]: Connection: close Apr 12 10:39:53 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:39:53 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:39:53 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:39:53 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:39:53 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:39:53 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolw_nYryFICsBs3LElhFE6paVxZf-iI0P3xbWrRbeaU25Lf5iwn-zPOW90w3Ix0basj9ly2ny_regvUP1VHGHvPqpdyFxpQRdzgwcCaXHkA7g6GiMMZUvTc7zxTi20Dun7VZ1OFiF6ozQXIq1ETPvxfzUeOW7MadsviWSySFOKZZ1k Apr 12 10:39:53 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:39:53 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:39:53 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:39:53 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:39:53 user devstack@n-api.service[61853]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 10:39:53 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:39:53 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:39:53 user devstack@n-api.service[61853]: X-Project-Id: 6981486a29b64ee7b9ef7cbf2ca852be Apr 12 10:39:53 user devstack@n-api.service[61853]: X-Project-Name: tempest-TaggedAttachmentsTest-2008645939 Apr 12 10:39:53 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:39:53 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:39:53 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6981486a29b64ee7b9ef7cbf2ca852be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6981486a29b64ee7b9ef7cbf2ca852be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6981486a29b64ee7b9ef7cbf2ca852be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:39:53 user devstack@n-api.service[61853]: X-Tenant: tempest-TaggedAttachmentsTest-2008645939 Apr 12 10:39:53 user devstack@n-api.service[61853]: X-Tenant-Id: 6981486a29b64ee7b9ef7cbf2ca852be Apr 12 10:39:53 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TaggedAttachmentsTest-2008645939 Apr 12 10:39:53 user devstack@n-api.service[61853]: X-User: tempest-TaggedAttachmentsTest-2008645939-project-member Apr 12 10:39:53 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:39:53 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:39:53 user devstack@n-api.service[61853]: X-User-Id: 254d3560065c4d8a8aaf312870be2967 Apr 12 10:39:53 user devstack@n-api.service[61853]: X-User-Name: tempest-TaggedAttachmentsTest-2008645939-project-member Apr 12 10:39:53 user devstack@n-api.service[61853]: method: > Apr 12 10:39:53 user devstack@n-api.service[61853]: exception: Instance f147b4ee-d130-41ae-a4db-bc248fb23266 could not be found. Apr 12 10:39:53 user devstack@n-api.service[61853]: action_args: {'id': 'f147b4ee-d130-41ae-a4db-bc248fb23266'} Apr 12 10:39:53 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f147b4ee-d130-41ae-a4db-bc248fb23266 could not be found. Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f147b4ee-d130-41ae-a4db-bc248fb23266 could not be found. Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f147b4ee-d130-41ae-a4db-bc248fb23266 could not be found. Apr 12 10:39:53 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:39:53 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-eb149bd3-e063-4384-b029-2fa40603fabc tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Returning 404 to user: Instance f147b4ee-d130-41ae-a4db-bc248fb23266 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:39:53 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-eb149bd3-e063-4384-b029-2fa40603fabc tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266" status: 404 len: 111 microversion: 2.49 time: 0.037030 Apr 12 10:39:53 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 102/314] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 10:39:53 2023] DELETE /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:39:53 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-9649bfb9-b874-4661-baad-617b34d24df5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:39:53 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-9649bfb9-b874-4661-baad-617b34d24df5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9649bfb9-b874-4661-baad-617b34d24df5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9649bfb9-b874-4661-baad-617b34d24df5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9649bfb9-b874-4661-baad-617b34d24df5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9649bfb9-b874-4661-baad-617b34d24df5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9649bfb9-b874-4661-baad-617b34d24df5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9649bfb9-b874-4661-baad-617b34d24df5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:53 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-9649bfb9-b874-4661-baad-617b34d24df5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] HTTP exception thrown: Instance f147b4ee-d130-41ae-a4db-bc248fb23266 could not be found. Apr 12 10:39:53 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-9649bfb9-b874-4661-baad-617b34d24df5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Request method failure captured: Apr 12 10:39:53 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266 HTTP/1.1 Apr 12 10:39:53 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:39:53 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:39:53 user devstack@n-api.service[61852]: Connection: close Apr 12 10:39:53 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:39:53 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:39:53 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:39:53 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:39:53 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:39:53 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNolw_nYryFICsBs3LElhFE6paVxZf-iI0P3xbWrRbeaU25Lf5iwn-zPOW90w3Ix0basj9ly2ny_regvUP1VHGHvPqpdyFxpQRdzgwcCaXHkA7g6GiMMZUvTc7zxTi20Dun7VZ1OFiF6ozQXIq1ETPvxfzUeOW7MadsviWSySFOKZZ1k Apr 12 10:39:53 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:39:53 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:39:53 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:39:53 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:39:53 user devstack@n-api.service[61852]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 10:39:53 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:39:53 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:39:53 user devstack@n-api.service[61852]: X-Project-Id: 6981486a29b64ee7b9ef7cbf2ca852be Apr 12 10:39:53 user devstack@n-api.service[61852]: X-Project-Name: tempest-TaggedAttachmentsTest-2008645939 Apr 12 10:39:53 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:39:53 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:39:53 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6981486a29b64ee7b9ef7cbf2ca852be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6981486a29b64ee7b9ef7cbf2ca852be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6981486a29b64ee7b9ef7cbf2ca852be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:39:53 user devstack@n-api.service[61852]: X-Tenant: tempest-TaggedAttachmentsTest-2008645939 Apr 12 10:39:53 user devstack@n-api.service[61852]: X-Tenant-Id: 6981486a29b64ee7b9ef7cbf2ca852be Apr 12 10:39:53 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-TaggedAttachmentsTest-2008645939 Apr 12 10:39:53 user devstack@n-api.service[61852]: X-User: tempest-TaggedAttachmentsTest-2008645939-project-member Apr 12 10:39:53 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:39:53 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:39:53 user devstack@n-api.service[61852]: X-User-Id: 254d3560065c4d8a8aaf312870be2967 Apr 12 10:39:53 user devstack@n-api.service[61852]: X-User-Name: tempest-TaggedAttachmentsTest-2008645939-project-member Apr 12 10:39:53 user devstack@n-api.service[61852]: method: > Apr 12 10:39:53 user devstack@n-api.service[61852]: exception: Instance f147b4ee-d130-41ae-a4db-bc248fb23266 could not be found. Apr 12 10:39:53 user devstack@n-api.service[61852]: action_args: {'id': 'f147b4ee-d130-41ae-a4db-bc248fb23266'} Apr 12 10:39:53 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f147b4ee-d130-41ae-a4db-bc248fb23266 could not be found. Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f147b4ee-d130-41ae-a4db-bc248fb23266 could not be found. Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f147b4ee-d130-41ae-a4db-bc248fb23266 could not be found. Apr 12 10:39:53 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:39:53 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-9649bfb9-b874-4661-baad-617b34d24df5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Returning 404 to user: Instance f147b4ee-d130-41ae-a4db-bc248fb23266 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:39:53 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-9649bfb9-b874-4661-baad-617b34d24df5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266" status: 404 len: 111 microversion: 2.49 time: 0.028203 Apr 12 10:39:53 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 105/315] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:39:53 2023] GET /compute/v2.1/servers/f147b4ee-d130-41ae-a4db-bc248fb23266 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:39:58 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:39:58 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dea9ff7f-5072-4321-a399-4f61bb957b28", "device": "/dev/vdb"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:39:58 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:39:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:39:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:39:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:39:58 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305962 Apr 12 10:39:58 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 109/316] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:39:58 2023] POST /compute/v2.1/servers/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:02 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-aac428ea-c910-411b-8e21-8b7623c9974b req-094117de-5147-4853-a577-164ebeca7152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "daf1aa56-7b24-4f41-93fd-a54cdf96428f"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-aac428ea-c910-411b-8e21-8b7623c9974b req-094117de-5147-4853-a577-164ebeca7152 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-aac428ea-c910-411b-8e21-8b7623c9974b req-094117de-5147-4853-a577-164ebeca7152 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-aac428ea-c910-411b-8e21-8b7623c9974b req-094117de-5147-4853-a577-164ebeca7152 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-aac428ea-c910-411b-8e21-8b7623c9974b req-094117de-5147-4853-a577-164ebeca7152 service nova] Creating event network-vif-plugged:daf1aa56-7b24-4f41-93fd-a54cdf96428f for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:40:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-aac428ea-c910-411b-8e21-8b7623c9974b req-094117de-5147-4853-a577-164ebeca7152 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043425 Apr 12 10:40:02 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 103/317] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:03 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-38f21379-f732-431f-844e-6d0532371590 req-b0f60ec6-dc18-4116-b9ee-9d12af44f5cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "fb79e431-1d99-40eb-94a0-20032fa213fb"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:03 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=5 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:40:03 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=5 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:40:03 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-38f21379-f732-431f-844e-6d0532371590 req-b0f60ec6-dc18-4116-b9ee-9d12af44f5cf service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:03 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-38f21379-f732-431f-844e-6d0532371590 req-b0f60ec6-dc18-4116-b9ee-9d12af44f5cf service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:03 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-38f21379-f732-431f-844e-6d0532371590 req-b0f60ec6-dc18-4116-b9ee-9d12af44f5cf service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:03 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-38f21379-f732-431f-844e-6d0532371590 req-b0f60ec6-dc18-4116-b9ee-9d12af44f5cf service nova] Creating event network-vif-plugged:fb79e431-1d99-40eb-94a0-20032fa213fb for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:40:03 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-38f21379-f732-431f-844e-6d0532371590 req-b0f60ec6-dc18-4116-b9ee-9d12af44f5cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062210 Apr 12 10:40:03 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 106/318] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ddd29313-0c42-4207-85dd-353349529bee tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:03 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-ddd29313-0c42-4207-85dd-353349529bee tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:40:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ddd29313-0c42-4207-85dd-353349529bee tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ddd29313-0c42-4207-85dd-353349529bee tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ddd29313-0c42-4207-85dd-353349529bee tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ddd29313-0c42-4207-85dd-353349529bee tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ddd29313-0c42-4207-85dd-353349529bee tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ddd29313-0c42-4207-85dd-353349529bee tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-ddd29313-0c42-4207-85dd-353349529bee tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] HTTP exception thrown: Instance ea55f551-968e-4ece-a37a-c4128ce5e8cb could not be found. Apr 12 10:40:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ddd29313-0c42-4207-85dd-353349529bee tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Request method failure captured: Apr 12 10:40:03 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb HTTP/1.1 Apr 12 10:40:03 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:40:03 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:40:03 user devstack@n-api.service[61854]: Connection: close Apr 12 10:40:03 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:40:03 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:40:03 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:40:03 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:40:03 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:40:03 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNolk5dLIsZeQkh9Pud_4LgigoQIS1raGK36Hm0wNblFBBaxLZZSiC1e3YMkAUc8bgNyVQ5cx7zaSGQtFD5oYKR81W7HTItjhIkyvRnLBEEbzeoVdbBi3yWRrSDqBcl5rAeS2YOl90--RUUqYfsBWMog0zwGtYtAUQv8q7sXca2qmtho Apr 12 10:40:03 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:40:03 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:40:03 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:40:03 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:40:03 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:40:03 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:40:03 user devstack@n-api.service[61854]: X-Project-Id: 91b7b715cc24490ebd04d5469b6e07ce Apr 12 10:40:03 user devstack@n-api.service[61854]: X-Project-Name: tempest-TestVolumeSwap-1349998885 Apr 12 10:40:03 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:40:03 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:40:03 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/91b7b715cc24490ebd04d5469b6e07ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91b7b715cc24490ebd04d5469b6e07ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91b7b715cc24490ebd04d5469b6e07ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:40:03 user devstack@n-api.service[61854]: X-Tenant: tempest-TestVolumeSwap-1349998885 Apr 12 10:40:03 user devstack@n-api.service[61854]: X-Tenant-Id: 91b7b715cc24490ebd04d5469b6e07ce Apr 12 10:40:03 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TestVolumeSwap-1349998885 Apr 12 10:40:03 user devstack@n-api.service[61854]: X-User: tempest-TestVolumeSwap-1349998885-project-member Apr 12 10:40:03 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:40:03 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:40:03 user devstack@n-api.service[61854]: X-User-Id: 80dbdeaccf84466286a6d85921e15a3f Apr 12 10:40:03 user devstack@n-api.service[61854]: X-User-Name: tempest-TestVolumeSwap-1349998885-project-member Apr 12 10:40:03 user devstack@n-api.service[61854]: method: > Apr 12 10:40:03 user devstack@n-api.service[61854]: exception: Instance ea55f551-968e-4ece-a37a-c4128ce5e8cb could not be found. Apr 12 10:40:03 user devstack@n-api.service[61854]: action_args: {'id': 'ea55f551-968e-4ece-a37a-c4128ce5e8cb'} Apr 12 10:40:03 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea55f551-968e-4ece-a37a-c4128ce5e8cb could not be found. Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea55f551-968e-4ece-a37a-c4128ce5e8cb could not be found. Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea55f551-968e-4ece-a37a-c4128ce5e8cb could not be found. Apr 12 10:40:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:40:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ddd29313-0c42-4207-85dd-353349529bee tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Returning 404 to user: Instance ea55f551-968e-4ece-a37a-c4128ce5e8cb could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:40:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ddd29313-0c42-4207-85dd-353349529bee tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb" status: 404 len: 111 microversion: 2.1 time: 0.029234 Apr 12 10:40:03 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 110/319] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:40:03 2023] GET /compute/v2.1/servers/ea55f551-968e-4ece-a37a-c4128ce5e8cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:40:03 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-79b3e38b-78b1-48d3-a3b1-09684f3c35f8 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Calling method '.version_select at 0x7fabbf73fa30>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:03 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-79b3e38b-78b1-48d3-a3b1-09684f3c35f8 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1030522827" status: 202 len: 0 microversion: 2.1 time: 0.029688 Apr 12 10:40:03 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 104/320] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 10:40:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1030522827 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:40:04 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-816b5efd-7696-40c8-95ca-d013f2b28749 req-70f520d3-5b74-4c92-8551-537ad867ced0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "825c6036-d16c-43ab-9f6a-2bb133bf51b8"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-816b5efd-7696-40c8-95ca-d013f2b28749 req-70f520d3-5b74-4c92-8551-537ad867ced0 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-816b5efd-7696-40c8-95ca-d013f2b28749 req-70f520d3-5b74-4c92-8551-537ad867ced0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-816b5efd-7696-40c8-95ca-d013f2b28749 req-70f520d3-5b74-4c92-8551-537ad867ced0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:04 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-816b5efd-7696-40c8-95ca-d013f2b28749 req-70f520d3-5b74-4c92-8551-537ad867ced0 service nova] Creating event network-vif-plugged:825c6036-d16c-43ab-9f6a-2bb133bf51b8 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:40:04 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-816b5efd-7696-40c8-95ca-d013f2b28749 req-70f520d3-5b74-4c92-8551-537ad867ced0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038763 Apr 12 10:40:04 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 107/321] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:04 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "daf1aa56-7b24-4f41-93fd-a54cdf96428f"}, {"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7"}, {"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7"}, {"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "e16e56f7-00ab-422d-95b3-d1b204f693a3"}, {"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "e16e56f7-00ab-422d-95b3-d1b204f693a3"}, {"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "3c8cf480-05d6-463a-a97e-a9d869ac3860"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Creating event network-vif-plugged:daf1aa56-7b24-4f41-93fd-a54cdf96428f for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:40:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Creating event network-vif-plugged:bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:40:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Creating event network-vif-plugged:bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:40:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Creating event network-vif-plugged:e16e56f7-00ab-422d-95b3-d1b204f693a3 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:40:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Creating event network-vif-plugged:e16e56f7-00ab-422d-95b3-d1b204f693a3 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:40:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Creating event network-vif-plugged:3c8cf480-05d6-463a-a97e-a9d869ac3860 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:40:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.038696 Apr 12 10:40:04 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 111/322] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:04 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:40:05 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3f1105e8-853b-4759-985c-594f8d324715 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:05 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-3f1105e8-853b-4759-985c-594f8d324715 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:40:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3f1105e8-853b-4759-985c-594f8d324715 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3f1105e8-853b-4759-985c-594f8d324715 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3f1105e8-853b-4759-985c-594f8d324715 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3f1105e8-853b-4759-985c-594f8d324715 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3f1105e8-853b-4759-985c-594f8d324715 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3f1105e8-853b-4759-985c-594f8d324715 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-3f1105e8-853b-4759-985c-594f8d324715 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] HTTP exception thrown: Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 could not be found. Apr 12 10:40:05 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3f1105e8-853b-4759-985c-594f8d324715 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Request method failure captured: Apr 12 10:40:05 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/893c42b2-83ed-4823-9698-2015a3ffd4c5 HTTP/1.1 Apr 12 10:40:05 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:40:05 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:40:05 user devstack@n-api.service[61853]: Connection: close Apr 12 10:40:05 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:40:05 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:40:05 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:40:05 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:40:05 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:40:05 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolyPj4uP3fUaGvJghQbYB0eJurMk0aTXOP8m_SRC4HCE3RKd0kG4NblpxL-3HoVpVY4fHbUBjkQR9sFtLPZCwY79AY01f-FnXJli2U-y_sg0L5mYp62dEOpZN86j2hPkA0DEz8im88zu7QIITcqH4-51-4fU1cE5F0swgyw4tBPWWI Apr 12 10:40:05 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:40:05 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:40:05 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:40:05 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:40:05 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:40:05 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:40:05 user devstack@n-api.service[61853]: X-Project-Id: 024682bfda5548b8b9b404c85dd55b34 Apr 12 10:40:05 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServersNegativeTestJSON-563292074 Apr 12 10:40:05 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:40:05 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:40:05 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/024682bfda5548b8b9b404c85dd55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/024682bfda5548b8b9b404c85dd55b34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/024682bfda5548b8b9b404c85dd55b34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:40:05 user devstack@n-api.service[61853]: X-Tenant: tempest-ServersNegativeTestJSON-563292074 Apr 12 10:40:05 user devstack@n-api.service[61853]: X-Tenant-Id: 024682bfda5548b8b9b404c85dd55b34 Apr 12 10:40:05 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServersNegativeTestJSON-563292074 Apr 12 10:40:05 user devstack@n-api.service[61853]: X-User: tempest-ServersNegativeTestJSON-563292074-project-member Apr 12 10:40:05 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:40:05 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:40:05 user devstack@n-api.service[61853]: X-User-Id: 33d19bfc4894401cb664521438338b9a Apr 12 10:40:05 user devstack@n-api.service[61853]: X-User-Name: tempest-ServersNegativeTestJSON-563292074-project-member Apr 12 10:40:05 user devstack@n-api.service[61853]: method: > Apr 12 10:40:05 user devstack@n-api.service[61853]: exception: Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 could not be found. Apr 12 10:40:05 user devstack@n-api.service[61853]: action_args: {'id': '893c42b2-83ed-4823-9698-2015a3ffd4c5'} Apr 12 10:40:05 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 could not be found. Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 could not be found. Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 could not be found. Apr 12 10:40:05 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:40:05 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3f1105e8-853b-4759-985c-594f8d324715 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Returning 404 to user: Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:40:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-3f1105e8-853b-4759-985c-594f8d324715 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/893c42b2-83ed-4823-9698-2015a3ffd4c5" status: 404 len: 111 microversion: 2.1 time: 0.036437 Apr 12 10:40:05 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 105/323] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:40:05 2023] GET /compute/v2.1/servers/893c42b2-83ed-4823-9698-2015a3ffd4c5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:40:05 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-d9d6f7ff-c735-4da1-8bd6-0688c53de703 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:05 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-d9d6f7ff-c735-4da1-8bd6-0688c53de703 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:40:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9d6f7ff-c735-4da1-8bd6-0688c53de703 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9d6f7ff-c735-4da1-8bd6-0688c53de703 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9d6f7ff-c735-4da1-8bd6-0688c53de703 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9d6f7ff-c735-4da1-8bd6-0688c53de703 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9d6f7ff-c735-4da1-8bd6-0688c53de703 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9d6f7ff-c735-4da1-8bd6-0688c53de703 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:05 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-d9d6f7ff-c735-4da1-8bd6-0688c53de703 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d19bfc4894401cb664521438338b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024682bfda5548b8b9b404c85dd55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:40:05 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-d9d6f7ff-c735-4da1-8bd6-0688c53de703 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586" status: 200 len: 1492 microversion: 2.1 time: 0.340053 Apr 12 10:40:05 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 108/324] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:40:05 2023] GET /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586 => generated 1492 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 10:40:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "fb79e431-1d99-40eb-94a0-20032fa213fb"}, {"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "13923b13-db35-4b98-b2b0-e2e18fd8441e"}, {"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "13923b13-db35-4b98-b2b0-e2e18fd8441e"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] Creating event network-vif-plugged:fb79e431-1d99-40eb-94a0-20032fa213fb for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:40:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] Creating event network-vif-plugged:13923b13-db35-4b98-b2b0-e2e18fd8441e for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:40:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] Creating event network-vif-plugged:13923b13-db35-4b98-b2b0-e2e18fd8441e for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:40:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038932 Apr 12 10:40:05 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 112/325] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:05 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:40:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-8bb27d9d-1767-4f1a-92d7-e6eecc0a4d49 req-a50a8fa5-93b6-4a97-a662-fa8151764b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "825c6036-d16c-43ab-9f6a-2bb133bf51b8"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8bb27d9d-1767-4f1a-92d7-e6eecc0a4d49 req-a50a8fa5-93b6-4a97-a662-fa8151764b99 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8bb27d9d-1767-4f1a-92d7-e6eecc0a4d49 req-a50a8fa5-93b6-4a97-a662-fa8151764b99 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8bb27d9d-1767-4f1a-92d7-e6eecc0a4d49 req-a50a8fa5-93b6-4a97-a662-fa8151764b99 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-8bb27d9d-1767-4f1a-92d7-e6eecc0a4d49 req-a50a8fa5-93b6-4a97-a662-fa8151764b99 service nova] Creating event network-vif-plugged:825c6036-d16c-43ab-9f6a-2bb133bf51b8 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:40:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-8bb27d9d-1767-4f1a-92d7-e6eecc0a4d49 req-a50a8fa5-93b6-4a97-a662-fa8151764b99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042931 Apr 12 10:40:06 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 106/326] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-856051e5-7183-408c-9690-d15d9ce9f47c req-20afb5e5-c955-4634-bc0c-d1ab36cc07e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "3c8cf480-05d6-463a-a97e-a9d869ac3860"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-856051e5-7183-408c-9690-d15d9ce9f47c req-20afb5e5-c955-4634-bc0c-d1ab36cc07e1 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-856051e5-7183-408c-9690-d15d9ce9f47c req-20afb5e5-c955-4634-bc0c-d1ab36cc07e1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-856051e5-7183-408c-9690-d15d9ce9f47c req-20afb5e5-c955-4634-bc0c-d1ab36cc07e1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:06 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-856051e5-7183-408c-9690-d15d9ce9f47c req-20afb5e5-c955-4634-bc0c-d1ab36cc07e1 service nova] Creating event network-vif-plugged:3c8cf480-05d6-463a-a97e-a9d869ac3860 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:40:06 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-856051e5-7183-408c-9690-d15d9ce9f47c req-20afb5e5-c955-4634-bc0c-d1ab36cc07e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047162 Apr 12 10:40:06 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 109/327] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:09 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-26ca92e8-4fa7-43ae-aedd-bfd4d664b16a tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] Calling method '.version_select at 0x7fabc1406200>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:09 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-26ca92e8-4fa7-43ae-aedd-bfd4d664b16a tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/dddbcf35-d0ba-45dd-89f5-08318ac6564a" status: 200 len: 350 microversion: 2.1 time: 0.207415 Apr 12 10:40:09 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 113/328] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 10:40:09 2023] GET /compute/v2.1/os-volumes/dddbcf35-d0ba-45dd-89f5-08318ac6564a => generated 350 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:10 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f02191c5-1193-4813-852f-c2dae93fdee5 tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] Calling method '.version_select at 0x7fabbfa2fd00>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:10 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f02191c5-1193-4813-852f-c2dae93fdee5 tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/12847e7f-6707-47df-9cf6-fd1d0a7ac27e" status: 200 len: 349 microversion: 2.1 time: 0.170268 Apr 12 10:40:10 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 107/329] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 10:40:10 2023] GET /compute/v2.1/os-volumes/12847e7f-6707-47df-9cf6-fd1d0a7ac27e => generated 349 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:12 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-d9a39916-8b09-419b-9e94-c845ce0815f8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:12 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-d9a39916-8b09-419b-9e94-c845ce0815f8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:40:12 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9a39916-8b09-419b-9e94-c845ce0815f8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:12 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9a39916-8b09-419b-9e94-c845ce0815f8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:12 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9a39916-8b09-419b-9e94-c845ce0815f8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:12 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9a39916-8b09-419b-9e94-c845ce0815f8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:12 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9a39916-8b09-419b-9e94-c845ce0815f8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:12 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9a39916-8b09-419b-9e94-c845ce0815f8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:12 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-d9a39916-8b09-419b-9e94-c845ce0815f8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c757f04065b9488ba75739e59d7be377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce2a3bde13e464f8df0a41f30c240ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:40:12 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-d9a39916-8b09-419b-9e94-c845ce0815f8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5" status: 200 len: 1703 microversion: 2.1 time: 0.197093 Apr 12 10:40:12 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 110/330] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:40:12 2023] GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5 => generated 1703 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:40:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e3912c3c-11fc-4151-9e9b-a1944470603b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:13 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e3912c3c-11fc-4151-9e9b-a1944470603b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:40:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e3912c3c-11fc-4151-9e9b-a1944470603b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e3912c3c-11fc-4151-9e9b-a1944470603b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e3912c3c-11fc-4151-9e9b-a1944470603b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e3912c3c-11fc-4151-9e9b-a1944470603b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e3912c3c-11fc-4151-9e9b-a1944470603b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e3912c3c-11fc-4151-9e9b-a1944470603b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:13 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a2e5e89d-c902-4461-a285-072ba3b0c9c2 tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] Calling method '.version_select at 0x7fabbf73f760>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:13 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-e3912c3c-11fc-4151-9e9b-a1944470603b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:40:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a2e5e89d-c902-4461-a285-072ba3b0c9c2 tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/10a6eaad-10e2-4bc0-b4c7-712653a00192" status: 200 len: 351 microversion: 2.1 time: 0.089978 Apr 12 10:40:13 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 108/331] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 10:40:13 2023] GET /compute/v2.1/os-volumes/10a6eaad-10e2-4bc0-b4c7-712653a00192 => generated 351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-e3912c3c-11fc-4151-9e9b-a1944470603b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1723 microversion: 2.1 time: 0.168809 Apr 12 10:40:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 114/332] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:40:13 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:40:13 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-783ddbdf-4a9d-4e2e-b21b-a43281232336 tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] Calling method '.version_select at 0x7fabbf86f910>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:13 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "dcd8eb9e-0a55-4444-a6e3-07f042d287a4"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:13 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:40:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:13 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-783ddbdf-4a9d-4e2e-b21b-a43281232336 tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.104697 Apr 12 10:40:13 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 111/333] 10.0.0.210 () {62 vars in 1211 bytes} [Wed Apr 12 10:40:13 2023] GET /compute/v2.1/os-volumes => generated 1033 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:40:13 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'flavor' on Instance uuid 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:40:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-58cbfa9a-c8f5-4619-ae0f-b8f91e10b9d6 tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] Calling method '.version_select at 0x7fabbf8415a0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-58cbfa9a-c8f5-4619-ae0f-b8f91e10b9d6 tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.102223 Apr 12 10:40:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 115/334] 10.0.0.210 () {62 vars in 1226 bytes} [Wed Apr 12 10:40:13 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:13 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-0c6be977-2165-4e33-8cd4-070eaf4e070f tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] Calling method '.version_select at 0x7fabbf8e79a0>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:13 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-0c6be977-2165-4e33-8cd4-070eaf4e070f tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.081502 Apr 12 10:40:13 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 112/335] 10.0.0.210 () {62 vars in 1211 bytes} [Wed Apr 12 10:40:13 2023] GET /compute/v2.1/os-volumes => generated 1033 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:40:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2236d5e3-405b-497b-ace4-e56f8539405e tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] Calling method '.version_select at 0x7fabbf8bf880>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2236d5e3-405b-497b-ace4-e56f8539405e tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.115336 Apr 12 10:40:14 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 116/336] 10.0.0.210 () {62 vars in 1244 bytes} [Wed Apr 12 10:40:13 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:14 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-096a68b2-610a-49ef-bc11-0d6b1df08b7b tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] Calling method '.version_select at 0x7fabbf86df30>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-096a68b2-610a-49ef-bc11-0d6b1df08b7b tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.100462 Apr 12 10:40:14 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 113/337] 10.0.0.210 () {62 vars in 1247 bytes} [Wed Apr 12 10:40:14 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:14 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-fcc31054-2d7f-4569-93e5-d320e1f6ca46 tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] Calling method '.version_select at 0x7fabbf843400>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/action" status: 200 len: 29 microversion: 2.87 time: 0.509033 Apr 12 10:40:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 109/338] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 10:40:13 2023] POST /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/action => generated 29 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:40:14 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-f9282897-ad2d-47ac-a899-51c67d1b3e40 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:14 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-f9282897-ad2d-47ac-a899-51c67d1b3e40 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:40:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f9282897-ad2d-47ac-a899-51c67d1b3e40 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f9282897-ad2d-47ac-a899-51c67d1b3e40 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f9282897-ad2d-47ac-a899-51c67d1b3e40 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f9282897-ad2d-47ac-a899-51c67d1b3e40 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f9282897-ad2d-47ac-a899-51c67d1b3e40 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f9282897-ad2d-47ac-a899-51c67d1b3e40 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-fcc31054-2d7f-4569-93e5-d320e1f6ca46 tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.122770 Apr 12 10:40:14 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 117/339] 10.0.0.210 () {62 vars in 1232 bytes} [Wed Apr 12 10:40:14 2023] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:40:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-12395810-a58f-4cdb-b2a3-ee72ff5c509d tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] Calling method '.version_select at 0x7fabbf73e8c0>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:14 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-f9282897-ad2d-47ac-a899-51c67d1b3e40 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:40:14 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-f9282897-ad2d-47ac-a899-51c67d1b3e40 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:40:14 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-f9282897-ad2d-47ac-a899-51c67d1b3e40 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:40:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-f9282897-ad2d-47ac-a899-51c67d1b3e40 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" status: 200 len: 1773 microversion: 2.87 time: 0.166169 Apr 12 10:40:14 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 114/340] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:40:14 2023] GET /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 => generated 1773 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:40:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-12395810-a58f-4cdb-b2a3-ee72ff5c509d tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.098443 Apr 12 10:40:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 110/341] 10.0.0.210 () {62 vars in 1265 bytes} [Wed Apr 12 10:40:14 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:14 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e7821de4-b002-4bef-b34f-68e1288ef792 tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] Calling method '.version_select at 0x7fabbf8bdfc0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-e7821de4-b002-4bef-b34f-68e1288ef792 tempest-VolumesTestJSON-1438950733 tempest-VolumesTestJSON-1438950733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.080010 Apr 12 10:40:14 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 118/342] 10.0.0.210 () {62 vars in 1232 bytes} [Wed Apr 12 10:40:14 2023] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:40:15 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-3559aa70-07b0-4229-9f44-26ae18432f7f req-38108234-a8cf-42d4-ada5-a1bb64d83cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212", "name": "network-vif-unplugged", "status": "completed", "tag": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-3559aa70-07b0-4229-9f44-26ae18432f7f req-38108234-a8cf-42d4-ada5-a1bb64d83cb6 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-3559aa70-07b0-4229-9f44-26ae18432f7f req-38108234-a8cf-42d4-ada5-a1bb64d83cb6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-3559aa70-07b0-4229-9f44-26ae18432f7f req-38108234-a8cf-42d4-ada5-a1bb64d83cb6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-3559aa70-07b0-4229-9f44-26ae18432f7f req-38108234-a8cf-42d4-ada5-a1bb64d83cb6 service nova] Creating event network-vif-unplugged:1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 on user Apr 12 10:40:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-3559aa70-07b0-4229-9f44-26ae18432f7f req-38108234-a8cf-42d4-ada5-a1bb64d83cb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033077 Apr 12 10:40:15 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 115/343] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:17 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-20c61e9e-064a-4844-b508-e4103a57ca55 req-c408727b-6396-4026-bca1-ef5dd40c480d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212", "name": "network-vif-plugged", "status": "completed", "tag": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:17 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:40:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-20c61e9e-064a-4844-b508-e4103a57ca55 req-c408727b-6396-4026-bca1-ef5dd40c480d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-20c61e9e-064a-4844-b508-e4103a57ca55 req-c408727b-6396-4026-bca1-ef5dd40c480d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-20c61e9e-064a-4844-b508-e4103a57ca55 req-c408727b-6396-4026-bca1-ef5dd40c480d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:17 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-20c61e9e-064a-4844-b508-e4103a57ca55 req-c408727b-6396-4026-bca1-ef5dd40c480d service nova] Creating event network-vif-plugged:1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 on user Apr 12 10:40:17 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-20c61e9e-064a-4844-b508-e4103a57ca55 req-c408727b-6396-4026-bca1-ef5dd40c480d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047421 Apr 12 10:40:17 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 111/344] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:20 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-4b89d6a3-2690-4ca9-80f0-2f18e0156eef req-a43cbc7c-3800-4770-87f0-7b592cd55966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212", "name": "network-vif-plugged", "status": "completed", "tag": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:20 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:40:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-4b89d6a3-2690-4ca9-80f0-2f18e0156eef req-a43cbc7c-3800-4770-87f0-7b592cd55966 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-4b89d6a3-2690-4ca9-80f0-2f18e0156eef req-a43cbc7c-3800-4770-87f0-7b592cd55966 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-4b89d6a3-2690-4ca9-80f0-2f18e0156eef req-a43cbc7c-3800-4770-87f0-7b592cd55966 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-4b89d6a3-2690-4ca9-80f0-2f18e0156eef req-a43cbc7c-3800-4770-87f0-7b592cd55966 service nova] Creating event network-vif-plugged:1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 on user Apr 12 10:40:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-4b89d6a3-2690-4ca9-80f0-2f18e0156eef req-a43cbc7c-3800-4770-87f0-7b592cd55966 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073609 Apr 12 10:40:20 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 119/345] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:22 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-e9c3f3b3-3e4b-4355-af4c-3c104246c256 req-9bcca6e8-d779-46f2-94d2-4f0fe1d085b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212", "name": "network-vif-plugged", "status": "completed", "tag": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e9c3f3b3-3e4b-4355-af4c-3c104246c256 req-9bcca6e8-d779-46f2-94d2-4f0fe1d085b0 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e9c3f3b3-3e4b-4355-af4c-3c104246c256 req-9bcca6e8-d779-46f2-94d2-4f0fe1d085b0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e9c3f3b3-3e4b-4355-af4c-3c104246c256 req-9bcca6e8-d779-46f2-94d2-4f0fe1d085b0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:22 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-e9c3f3b3-3e4b-4355-af4c-3c104246c256 req-9bcca6e8-d779-46f2-94d2-4f0fe1d085b0 service nova] Creating event network-vif-plugged:1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 on user Apr 12 10:40:22 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-e9c3f3b3-3e4b-4355-af4c-3c104246c256 req-9bcca6e8-d779-46f2-94d2-4f0fe1d085b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047001 Apr 12 10:40:22 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 116/346] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:26 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:26 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:40:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:26 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:40:26 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lazy-loading 'services' on Instance uuid a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:40:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/os-volume_attachments/dea9ff7f-5072-4321-a399-4f61bb957b28" status: 202 len: 0 microversion: 2.1 time: 0.246737 Apr 12 10:40:26 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 112/347] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 10:40:26 2023] DELETE /compute/v2.1/servers/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/os-volume_attachments/dea9ff7f-5072-4321-a399-4f61bb957b28 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:40:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:26 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:40:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:26 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:40:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" status: 204 len: 0 microversion: 2.1 time: 0.181289 Apr 12 10:40:26 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 120/348] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:40:26 2023] DELETE /compute/v2.1/servers/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:40:26 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-14fb3be9-74c2-4952-9558-a4487acdf456 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:26 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-14fb3be9-74c2-4952-9558-a4487acdf456 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:40:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-14fb3be9-74c2-4952-9558-a4487acdf456 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-14fb3be9-74c2-4952-9558-a4487acdf456 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-14fb3be9-74c2-4952-9558-a4487acdf456 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-14fb3be9-74c2-4952-9558-a4487acdf456 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-14fb3be9-74c2-4952-9558-a4487acdf456 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-14fb3be9-74c2-4952-9558-a4487acdf456 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:26 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-14fb3be9-74c2-4952-9558-a4487acdf456 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c97c57a3e7142d088e1cf315f5d8d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16de154a6d344b18a939c6a1b1a679f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:40:26 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-14fb3be9-74c2-4952-9558-a4487acdf456 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" status: 200 len: 1548 microversion: 2.1 time: 0.261100 Apr 12 10:40:26 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 117/349] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:40:26 2023] GET /compute/v2.1/servers/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 => generated 1548 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:40:28 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-afaca8cd-e42b-4877-a12d-e3b25d2c147a tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:28 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-afaca8cd-e42b-4877-a12d-e3b25d2c147a tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:40:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-afaca8cd-e42b-4877-a12d-e3b25d2c147a tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-afaca8cd-e42b-4877-a12d-e3b25d2c147a tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-afaca8cd-e42b-4877-a12d-e3b25d2c147a tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-afaca8cd-e42b-4877-a12d-e3b25d2c147a tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-afaca8cd-e42b-4877-a12d-e3b25d2c147a tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-afaca8cd-e42b-4877-a12d-e3b25d2c147a tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:28 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-afaca8cd-e42b-4877-a12d-e3b25d2c147a tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21034326c41f487181d19f60e0ccf219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ec9852adb94a5086dc3ef48871d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:40:28 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-afaca8cd-e42b-4877-a12d-e3b25d2c147a tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21034326c41f487181d19f60e0ccf219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ec9852adb94a5086dc3ef48871d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:40:28 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-afaca8cd-e42b-4877-a12d-e3b25d2c147a tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21034326c41f487181d19f60e0ccf219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ec9852adb94a5086dc3ef48871d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:40:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-afaca8cd-e42b-4877-a12d-e3b25d2c147a tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8" status: 200 len: 2824 microversion: 2.32 time: 0.359622 Apr 12 10:40:28 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 113/350] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:40:28 2023] GET /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8 => generated 2824 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:40:28 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-a8ecaab9-95ed-47cc-87c1-c1910553d997 req-57afdec0-1694-46ed-8048-af0b4c95c2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2", "name": "network-vif-unplugged", "status": "completed", "tag": "5eed0079-0c02-43b0-8124-4ef257a7eb1f"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a8ecaab9-95ed-47cc-87c1-c1910553d997 req-57afdec0-1694-46ed-8048-af0b4c95c2b6 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a8ecaab9-95ed-47cc-87c1-c1910553d997 req-57afdec0-1694-46ed-8048-af0b4c95c2b6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a8ecaab9-95ed-47cc-87c1-c1910553d997 req-57afdec0-1694-46ed-8048-af0b4c95c2b6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:28 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:40:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-a8ecaab9-95ed-47cc-87c1-c1910553d997 req-57afdec0-1694-46ed-8048-af0b4c95c2b6 service nova] Creating event network-vif-unplugged:5eed0079-0c02-43b0-8124-4ef257a7eb1f for instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 on user Apr 12 10:40:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-a8ecaab9-95ed-47cc-87c1-c1910553d997 req-57afdec0-1694-46ed-8048-af0b4c95c2b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062183 Apr 12 10:40:29 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 121/351] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:30 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-fe9ffa83-b63d-4007-a375-e6b2759666de req-09755bc0-b812-4c57-9749-fc854a35c333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2", "name": "network-vif-deleted", "tag": "5eed0079-0c02-43b0-8124-4ef257a7eb1f"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:30 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-fe9ffa83-b63d-4007-a375-e6b2759666de req-09755bc0-b812-4c57-9749-fc854a35c333 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:30 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-fe9ffa83-b63d-4007-a375-e6b2759666de req-09755bc0-b812-4c57-9749-fc854a35c333 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:30 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-fe9ffa83-b63d-4007-a375-e6b2759666de req-09755bc0-b812-4c57-9749-fc854a35c333 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:30 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-fe9ffa83-b63d-4007-a375-e6b2759666de req-09755bc0-b812-4c57-9749-fc854a35c333 service nova] Creating event network-vif-deleted:5eed0079-0c02-43b0-8124-4ef257a7eb1f for instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 on user Apr 12 10:40:30 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-fe9ffa83-b63d-4007-a375-e6b2759666de req-09755bc0-b812-4c57-9749-fc854a35c333 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.339985 Apr 12 10:40:30 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 118/352] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-6b841230-e404-4f01-9c41-30de37d06fb7 req-3e69e47c-958c-46b3-bccf-5aa606fd5ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2", "name": "network-vif-plugged", "status": "completed", "tag": "5eed0079-0c02-43b0-8124-4ef257a7eb1f"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6b841230-e404-4f01-9c41-30de37d06fb7 req-3e69e47c-958c-46b3-bccf-5aa606fd5ec1 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6b841230-e404-4f01-9c41-30de37d06fb7 req-3e69e47c-958c-46b3-bccf-5aa606fd5ec1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6b841230-e404-4f01-9c41-30de37d06fb7 req-3e69e47c-958c-46b3-bccf-5aa606fd5ec1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-6b841230-e404-4f01-9c41-30de37d06fb7 req-3e69e47c-958c-46b3-bccf-5aa606fd5ec1 service nova] Creating event network-vif-plugged:5eed0079-0c02-43b0-8124-4ef257a7eb1f for instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 on user Apr 12 10:40:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-6b841230-e404-4f01-9c41-30de37d06fb7 req-3e69e47c-958c-46b3-bccf-5aa606fd5ec1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039210 Apr 12 10:40:31 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 114/353] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6f862160-804a-463e-bb5a-53195c712aa8 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:31 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-6f862160-804a-463e-bb5a-53195c712aa8 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:40:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6f862160-804a-463e-bb5a-53195c712aa8 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6f862160-804a-463e-bb5a-53195c712aa8 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6f862160-804a-463e-bb5a-53195c712aa8 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6f862160-804a-463e-bb5a-53195c712aa8 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6f862160-804a-463e-bb5a-53195c712aa8 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6f862160-804a-463e-bb5a-53195c712aa8 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-6f862160-804a-463e-bb5a-53195c712aa8 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.150902 Apr 12 10:40:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 122/354] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 10:40:31 2023] GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa/os-interface => generated 282 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:40:32 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-acc5dda7-4267-481d-ad40-c8259ad54543 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:32 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-acc5dda7-4267-481d-ad40-c8259ad54543 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:40:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-acc5dda7-4267-481d-ad40-c8259ad54543 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-acc5dda7-4267-481d-ad40-c8259ad54543 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-acc5dda7-4267-481d-ad40-c8259ad54543 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-acc5dda7-4267-481d-ad40-c8259ad54543 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-acc5dda7-4267-481d-ad40-c8259ad54543 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-acc5dda7-4267-481d-ad40-c8259ad54543 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:33 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-acc5dda7-4267-481d-ad40-c8259ad54543 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa/ips" status: 200 len: 109 microversion: 2.20 time: 0.041882 Apr 12 10:40:33 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 119/355] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 12 10:40:32 2023] GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa/ips => generated 109 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:40:33 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-3a492318-eddd-46ac-b230-aa78249b13d0 req-d6705ff8-7716-47e9-9762-82c3cd817129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bfafa79-ce40-42f1-9992-10e50734f7fa", "tag": "4de5a799-c343-4e41-88ef-ebaaa3adb14c"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3a492318-eddd-46ac-b230-aa78249b13d0 req-d6705ff8-7716-47e9-9762-82c3cd817129 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3a492318-eddd-46ac-b230-aa78249b13d0 req-d6705ff8-7716-47e9-9762-82c3cd817129 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3a492318-eddd-46ac-b230-aa78249b13d0 req-d6705ff8-7716-47e9-9762-82c3cd817129 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:33 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-3a492318-eddd-46ac-b230-aa78249b13d0 req-d6705ff8-7716-47e9-9762-82c3cd817129 service nova] Creating event network-changed:4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance 0bfafa79-ce40-42f1-9992-10e50734f7fa on user Apr 12 10:40:33 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-3a492318-eddd-46ac-b230-aa78249b13d0 req-d6705ff8-7716-47e9-9762-82c3cd817129 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037040 Apr 12 10:40:33 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 115/356] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:35 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:40:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:35 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'flavor' on Instance uuid 0bfafa79-ce40-42f1-9992-10e50734f7fa {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:40:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa/action" status: 202 len: 0 microversion: 2.20 time: 0.851000 Apr 12 10:40:36 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 123/357] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 10:40:35 2023] POST /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa/action => generated 0 bytes in 853 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 12 10:40:36 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-70cb6306-c822-49ee-95e7-63389afd1034 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:36 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-70cb6306-c822-49ee-95e7-63389afd1034 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:40:36 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=25 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:40:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-70cb6306-c822-49ee-95e7-63389afd1034 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-70cb6306-c822-49ee-95e7-63389afd1034 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-70cb6306-c822-49ee-95e7-63389afd1034 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-70cb6306-c822-49ee-95e7-63389afd1034 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-70cb6306-c822-49ee-95e7-63389afd1034 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-70cb6306-c822-49ee-95e7-63389afd1034 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:36 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=41 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:40:36 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-70cb6306-c822-49ee-95e7-63389afd1034 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:40:36 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-70cb6306-c822-49ee-95e7-63389afd1034 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:40:36 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-70cb6306-c822-49ee-95e7-63389afd1034 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:40:36 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-70cb6306-c822-49ee-95e7-63389afd1034 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa" status: 200 len: 1711 microversion: 2.20 time: 0.233435 Apr 12 10:40:36 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 120/358] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:40:36 2023] GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa => generated 1711 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:40:36 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-42df3eb9-a147-4c16-b396-d5e63e9fbd4a req-f8679767-923d-4476-9df1-a22f01302cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bfafa79-ce40-42f1-9992-10e50734f7fa", "name": "network-vif-unplugged", "status": "completed", "tag": "4de5a799-c343-4e41-88ef-ebaaa3adb14c"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-42df3eb9-a147-4c16-b396-d5e63e9fbd4a req-f8679767-923d-4476-9df1-a22f01302cd0 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-42df3eb9-a147-4c16-b396-d5e63e9fbd4a req-f8679767-923d-4476-9df1-a22f01302cd0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-42df3eb9-a147-4c16-b396-d5e63e9fbd4a req-f8679767-923d-4476-9df1-a22f01302cd0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-42df3eb9-a147-4c16-b396-d5e63e9fbd4a req-f8679767-923d-4476-9df1-a22f01302cd0 service nova] Creating event network-vif-unplugged:4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance 0bfafa79-ce40-42f1-9992-10e50734f7fa on user Apr 12 10:40:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-42df3eb9-a147-4c16-b396-d5e63e9fbd4a req-f8679767-923d-4476-9df1-a22f01302cd0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056446 Apr 12 10:40:36 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 116/359] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-ef74f916-268e-40e5-a444-c3a52f92e1c8 req-c3066aaa-4d4e-4b16-8b90-9c5511bc299e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bfafa79-ce40-42f1-9992-10e50734f7fa", "name": "network-vif-plugged", "status": "completed", "tag": "4de5a799-c343-4e41-88ef-ebaaa3adb14c"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ef74f916-268e-40e5-a444-c3a52f92e1c8 req-c3066aaa-4d4e-4b16-8b90-9c5511bc299e service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ef74f916-268e-40e5-a444-c3a52f92e1c8 req-c3066aaa-4d4e-4b16-8b90-9c5511bc299e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ef74f916-268e-40e5-a444-c3a52f92e1c8 req-c3066aaa-4d4e-4b16-8b90-9c5511bc299e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-ef74f916-268e-40e5-a444-c3a52f92e1c8 req-c3066aaa-4d4e-4b16-8b90-9c5511bc299e service nova] Creating event network-vif-plugged:4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance 0bfafa79-ce40-42f1-9992-10e50734f7fa on user Apr 12 10:40:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-ef74f916-268e-40e5-a444-c3a52f92e1c8 req-c3066aaa-4d4e-4b16-8b90-9c5511bc299e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038977 Apr 12 10:40:38 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 124/360] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:38 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-0fd7d48e-254a-418e-945d-d8ee92dab0d7 tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c7c5399a-94dc-4322-8d8d-96cf7ed0d158"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:38 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-0fd7d48e-254a-418e-945d-d8ee92dab0d7 tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:40:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0fd7d48e-254a-418e-945d-d8ee92dab0d7 tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0fd7d48e-254a-418e-945d-d8ee92dab0d7 tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0fd7d48e-254a-418e-945d-d8ee92dab0d7 tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0fd7d48e-254a-418e-945d-d8ee92dab0d7 tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0fd7d48e-254a-418e-945d-d8ee92dab0d7 tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0fd7d48e-254a-418e-945d-d8ee92dab0d7 tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:39 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-0fd7d48e-254a-418e-945d-d8ee92dab0d7 tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] HTTP exception thrown: Volume 30f2c6a0-5656-4ef0-8041-5597adba87dc could not be found. Apr 12 10:40:39 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-0fd7d48e-254a-418e-945d-d8ee92dab0d7 tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] Request method failure captured: Apr 12 10:40:39 user devstack@n-api.service[61852]: request: PUT /compute/v2.1/servers/1c663163-6794-4c92-a401-5bc15d112c65/os-volume_attachments/30f2c6a0-5656-4ef0-8041-5597adba87dc HTTP/1.1 Apr 12 10:40:39 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:40:39 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:40:39 user devstack@n-api.service[61852]: Connection: close Apr 12 10:40:39 user devstack@n-api.service[61852]: Content-Length: 74 Apr 12 10:40:39 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:40:39 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:40:39 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:40:39 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:40:39 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNomC8S1ZDJGMJwHs8RONxE9bqwnREhucp8kRbwJDOWUq-QDzjA7_FzPAPCCXAV2FPbX7uHXXYjNzCB_77eM64JRmk4IO-EW6_ko-oN8nl8na7KxZye5Ubgg4so08HIpp0DHcNIM-O4tKmVoeQY_iQXTqlVxkNGSeTJQyvgj4J6Fyt68 Apr 12 10:40:39 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:40:39 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:40:39 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:40:39 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:40:39 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:40:39 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:40:39 user devstack@n-api.service[61852]: X-Project-Id: 63a4674f9051465ab68de067645d78e9 Apr 12 10:40:39 user devstack@n-api.service[61852]: X-Project-Name: tempest-VolumesAdminNegativeTest-1043576201 Apr 12 10:40:39 user devstack@n-api.service[61852]: X-Role: admin,member,reader Apr 12 10:40:39 user devstack@n-api.service[61852]: X-Roles: admin,member,reader Apr 12 10:40:39 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/63a4674f9051465ab68de067645d78e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63a4674f9051465ab68de067645d78e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63a4674f9051465ab68de067645d78e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:40:39 user devstack@n-api.service[61852]: X-Tenant: tempest-VolumesAdminNegativeTest-1043576201 Apr 12 10:40:39 user devstack@n-api.service[61852]: X-Tenant-Id: 63a4674f9051465ab68de067645d78e9 Apr 12 10:40:39 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1043576201 Apr 12 10:40:39 user devstack@n-api.service[61852]: X-User: tempest-VolumesAdminNegativeTest-1043576201-project-admin Apr 12 10:40:39 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:40:39 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:40:39 user devstack@n-api.service[61852]: X-User-Id: 9da3d8a3c45b488ea1aacb2219d5bb1d Apr 12 10:40:39 user devstack@n-api.service[61852]: X-User-Name: tempest-VolumesAdminNegativeTest-1043576201-project-admin Apr 12 10:40:39 user devstack@n-api.service[61852]: Apr 12 10:40:39 user devstack@n-api.service[61852]: {"volumeAttachment": {"volumeId": "c7c5399a-94dc-4322-8d8d-96cf7ed0d158"}} Apr 12 10:40:39 user devstack@n-api.service[61852]: method: > Apr 12 10:40:39 user devstack@n-api.service[61852]: exception: Volume 30f2c6a0-5656-4ef0-8041-5597adba87dc could not be found. Apr 12 10:40:39 user devstack@n-api.service[61852]: action_args: {'server_id': '1c663163-6794-4c92-a401-5bc15d112c65', 'id': '30f2c6a0-5656-4ef0-8041-5597adba87dc', 'body': {'volumeAttachment': {'volumeId': 'c7c5399a-94dc-4322-8d8d-96cf7ed0d158'}}} Apr 12 10:40:39 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30f2c6a0-5656-4ef0-8041-5597adba87dc could not be found. (HTTP 404) (Request-ID: req-a2b33b2e-4079-4f2d-a01c-4285761adc67) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30f2c6a0-5656-4ef0-8041-5597adba87dc could not be found. Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30f2c6a0-5656-4ef0-8041-5597adba87dc could not be found. Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30f2c6a0-5656-4ef0-8041-5597adba87dc could not be found. Apr 12 10:40:39 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:40:39 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-0fd7d48e-254a-418e-945d-d8ee92dab0d7 tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] Returning 404 to user: Volume 30f2c6a0-5656-4ef0-8041-5597adba87dc could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:40:39 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-0fd7d48e-254a-418e-945d-d8ee92dab0d7 tempest-VolumesAdminNegativeTest-1043576201 tempest-VolumesAdminNegativeTest-1043576201-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/1c663163-6794-4c92-a401-5bc15d112c65/os-volume_attachments/30f2c6a0-5656-4ef0-8041-5597adba87dc" status: 404 len: 109 microversion: 2.1 time: 0.131362 Apr 12 10:40:39 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 121/361] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 10:40:38 2023] PUT /compute/v2.1/servers/1c663163-6794-4c92-a401-5bc15d112c65/os-volume_attachments/30f2c6a0-5656-4ef0-8041-5597adba87dc => generated 109 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:40:41 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:41 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:40:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:41 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:40:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1c663163-6794-4c92-a401-5bc15d112c65" status: 204 len: 0 microversion: 2.1 time: 0.140281 Apr 12 10:40:41 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 117/362] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:40:41 2023] DELETE /compute/v2.1/servers/1c663163-6794-4c92-a401-5bc15d112c65 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:40:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-47fc6ccb-c6ee-42a1-b484-502f381a6c08 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:40:41 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-47fc6ccb-c6ee-42a1-b484-502f381a6c08 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:40:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-47fc6ccb-c6ee-42a1-b484-502f381a6c08 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-47fc6ccb-c6ee-42a1-b484-502f381a6c08 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-47fc6ccb-c6ee-42a1-b484-502f381a6c08 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-47fc6ccb-c6ee-42a1-b484-502f381a6c08 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-47fc6ccb-c6ee-42a1-b484-502f381a6c08 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-47fc6ccb-c6ee-42a1-b484-502f381a6c08 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:41 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-47fc6ccb-c6ee-42a1-b484-502f381a6c08 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a2243c6c9f431da846cc54ec181fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb8217b1544db384bebe1059848bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:40:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-47fc6ccb-c6ee-42a1-b484-502f381a6c08 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c663163-6794-4c92-a401-5bc15d112c65" status: 200 len: 1500 microversion: 2.1 time: 0.225465 Apr 12 10:40:41 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 125/363] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:40:41 2023] GET /compute/v2.1/servers/1c663163-6794-4c92-a401-5bc15d112c65 => generated 1500 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:40:41 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-976fa075-67e0-4bcf-903f-ee4113108649 req-6fa0258a-0bc5-4432-9bbc-56d852fa4149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bfafa79-ce40-42f1-9992-10e50734f7fa", "tag": "4de5a799-c343-4e41-88ef-ebaaa3adb14c"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-976fa075-67e0-4bcf-903f-ee4113108649 req-6fa0258a-0bc5-4432-9bbc-56d852fa4149 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-976fa075-67e0-4bcf-903f-ee4113108649 req-6fa0258a-0bc5-4432-9bbc-56d852fa4149 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-976fa075-67e0-4bcf-903f-ee4113108649 req-6fa0258a-0bc5-4432-9bbc-56d852fa4149 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:41 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-976fa075-67e0-4bcf-903f-ee4113108649 req-6fa0258a-0bc5-4432-9bbc-56d852fa4149 service nova] Creating event network-changed:4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance 0bfafa79-ce40-42f1-9992-10e50734f7fa on user Apr 12 10:40:41 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-976fa075-67e0-4bcf-903f-ee4113108649 req-6fa0258a-0bc5-4432-9bbc-56d852fa4149 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031874 Apr 12 10:40:41 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 122/364] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:42 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-44b0087f-a620-473a-aeed-711d43b42001 req-4cc885d0-5738-45dc-8e5e-f103437cf738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c663163-6794-4c92-a401-5bc15d112c65", "name": "network-vif-deleted", "tag": "6b5da29f-d5cb-4af2-ab48-c296b053e407"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-44b0087f-a620-473a-aeed-711d43b42001 req-4cc885d0-5738-45dc-8e5e-f103437cf738 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-44b0087f-a620-473a-aeed-711d43b42001 req-4cc885d0-5738-45dc-8e5e-f103437cf738 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-44b0087f-a620-473a-aeed-711d43b42001 req-4cc885d0-5738-45dc-8e5e-f103437cf738 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-44b0087f-a620-473a-aeed-711d43b42001 req-4cc885d0-5738-45dc-8e5e-f103437cf738 service nova] Creating event network-vif-deleted:6b5da29f-d5cb-4af2-ab48-c296b053e407 for instance 1c663163-6794-4c92-a401-5bc15d112c65 on user Apr 12 10:40:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-44b0087f-a620-473a-aeed-711d43b42001 req-4cc885d0-5738-45dc-8e5e-f103437cf738 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225197 Apr 12 10:40:42 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 118/365] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:40:43 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c663163-6794-4c92-a401-5bc15d112c65", "name": "network-vif-unplugged", "status": "completed", "tag": "6b5da29f-d5cb-4af2-ab48-c296b053e407"}, {"server_uuid": "1c663163-6794-4c92-a401-5bc15d112c65", "name": "network-vif-plugged", "status": "completed", "tag": "6b5da29f-d5cb-4af2-ab48-c296b053e407"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:40:43 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:40:43 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:40:43 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:40:43 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] Creating event network-vif-unplugged:6b5da29f-d5cb-4af2-ab48-c296b053e407 for instance 1c663163-6794-4c92-a401-5bc15d112c65 on user Apr 12 10:40:43 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] Creating event network-vif-plugged:6b5da29f-d5cb-4af2-ab48-c296b053e407 for instance 1c663163-6794-4c92-a401-5bc15d112c65 on user Apr 12 10:40:43 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.039968 Apr 12 10:40:43 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 126/366] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:40:43 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:04 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=5 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:41:04 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=11 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:41:04 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-1cb8be8e-cb63-48cf-81c1-7fced3f7dc90 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:04 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-1cb8be8e-cb63-48cf-81c1-7fced3f7dc90 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-1cb8be8e-cb63-48cf-81c1-7fced3f7dc90 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-1cb8be8e-cb63-48cf-81c1-7fced3f7dc90 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-1cb8be8e-cb63-48cf-81c1-7fced3f7dc90 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-1cb8be8e-cb63-48cf-81c1-7fced3f7dc90 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-1cb8be8e-cb63-48cf-81c1-7fced3f7dc90 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-1cb8be8e-cb63-48cf-81c1-7fced3f7dc90 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:04 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-1cb8be8e-cb63-48cf-81c1-7fced3f7dc90 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:04 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-1cb8be8e-cb63-48cf-81c1-7fced3f7dc90 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:04 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-1cb8be8e-cb63-48cf-81c1-7fced3f7dc90 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:04 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-1cb8be8e-cb63-48cf-81c1-7fced3f7dc90 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" status: 200 len: 1753 microversion: 2.87 time: 0.466555 Apr 12 10:41:04 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 123/367] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:41:04 2023] GET /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 => generated 1753 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:41:07 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:41:07 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:41:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-eff3e02d-f382-487f-94f6-d6898a03548a tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1426281684", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "512c09ce-f9cc-4c53-8989-fe2569e21108", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "092e35b9-633d-403b-a777-df3e8c018327"}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-eff3e02d-f382-487f-94f6-d6898a03548a tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] HTTP exception thrown: Block Device 512c09ce-f9cc-4c53-8989-fe2569e21108 is not bootable. Apr 12 10:41:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-eff3e02d-f382-487f-94f6-d6898a03548a tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Request method failure captured: Apr 12 10:41:07 user devstack@n-api.service[61853]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 12 10:41:07 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:41:07 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:41:07 user devstack@n-api.service[61853]: Connection: close Apr 12 10:41:07 user devstack@n-api.service[61853]: Content-Length: 357 Apr 12 10:41:07 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:41:07 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:41:07 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:41:07 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:41:07 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolyPj4uP3fUaGvJghQbYB0eJurMk0aTXOP8m_SRC4HCE3RKd0kG4NblpxL-3HoVpVY4fHbUBjkQR9sFtLPZCwY79AY01f-FnXJli2U-y_sg0L5mYp62dEOpZN86j2hPkA0DEz8im88zu7QIITcqH4-51-4fU1cE5F0swgyw4tBPWWI Apr 12 10:41:07 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:41:07 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:41:07 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:41:07 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:41:07 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:41:07 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:41:07 user devstack@n-api.service[61853]: X-Project-Id: 024682bfda5548b8b9b404c85dd55b34 Apr 12 10:41:07 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServersNegativeTestJSON-563292074 Apr 12 10:41:07 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:41:07 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:41:07 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/024682bfda5548b8b9b404c85dd55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/024682bfda5548b8b9b404c85dd55b34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/024682bfda5548b8b9b404c85dd55b34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:41:07 user devstack@n-api.service[61853]: X-Tenant: tempest-ServersNegativeTestJSON-563292074 Apr 12 10:41:07 user devstack@n-api.service[61853]: X-Tenant-Id: 024682bfda5548b8b9b404c85dd55b34 Apr 12 10:41:07 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServersNegativeTestJSON-563292074 Apr 12 10:41:07 user devstack@n-api.service[61853]: X-User: tempest-ServersNegativeTestJSON-563292074-project-member Apr 12 10:41:07 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:41:07 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:41:07 user devstack@n-api.service[61853]: X-User-Id: 33d19bfc4894401cb664521438338b9a Apr 12 10:41:07 user devstack@n-api.service[61853]: X-User-Name: tempest-ServersNegativeTestJSON-563292074-project-member Apr 12 10:41:07 user devstack@n-api.service[61853]: Apr 12 10:41:07 user devstack@n-api.service[61853]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1426281684", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "512c09ce-f9cc-4c53-8989-fe2569e21108", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "092e35b9-633d-403b-a777-df3e8c018327"}]}} Apr 12 10:41:07 user devstack@n-api.service[61853]: method: > Apr 12 10:41:07 user devstack@n-api.service[61853]: exception: Block Device 512c09ce-f9cc-4c53-8989-fe2569e21108 is not bootable. Apr 12 10:41:07 user devstack@n-api.service[61853]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1426281684', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '512c09ce-f9cc-4c53-8989-fe2569e21108'}], 'networks': [{'uuid': '092e35b9-633d-403b-a777-df3e8c018327'}]}}} Apr 12 10:41:07 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 512c09ce-f9cc-4c53-8989-fe2569e21108 is not bootable. Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 512c09ce-f9cc-4c53-8989-fe2569e21108 is not bootable. Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 512c09ce-f9cc-4c53-8989-fe2569e21108 is not bootable. Apr 12 10:41:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:41:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-eff3e02d-f382-487f-94f6-d6898a03548a tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Returning 400 to user: Block Device 512c09ce-f9cc-4c53-8989-fe2569e21108 is not bootable. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:41:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-eff3e02d-f382-487f-94f6-d6898a03548a tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.108348 Apr 12 10:41:07 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 119/368] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:41:07 2023] POST /compute/v2.1/servers => generated 110 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:41:07 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:41:07 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:41:07 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8586f126-0d5a-4a2e-a123-1e4463fde0fd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:07 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-8586f126-0d5a-4a2e-a123-1e4463fde0fd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8586f126-0d5a-4a2e-a123-1e4463fde0fd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8586f126-0d5a-4a2e-a123-1e4463fde0fd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8586f126-0d5a-4a2e-a123-1e4463fde0fd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8586f126-0d5a-4a2e-a123-1e4463fde0fd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8586f126-0d5a-4a2e-a123-1e4463fde0fd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8586f126-0d5a-4a2e-a123-1e4463fde0fd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:07 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-8586f126-0d5a-4a2e-a123-1e4463fde0fd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d19bfc4894401cb664521438338b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024682bfda5548b8b9b404c85dd55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:07 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8586f126-0d5a-4a2e-a123-1e4463fde0fd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586" status: 200 len: 1492 microversion: 2.1 time: 0.232165 Apr 12 10:41:07 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 127/369] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:41:07 2023] GET /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586 => generated 1492 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:41:13 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-2843959a-dceb-4612-9105-756135a7ecd8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:13 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-2843959a-dceb-4612-9105-756135a7ecd8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2843959a-dceb-4612-9105-756135a7ecd8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2843959a-dceb-4612-9105-756135a7ecd8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2843959a-dceb-4612-9105-756135a7ecd8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2843959a-dceb-4612-9105-756135a7ecd8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2843959a-dceb-4612-9105-756135a7ecd8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2843959a-dceb-4612-9105-756135a7ecd8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:13 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-2843959a-dceb-4612-9105-756135a7ecd8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5/action" status: 202 len: 0 microversion: 2.1 time: 0.351470 Apr 12 10:41:13 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 124/370] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:41:12 2023] POST /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:41:13 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-42abca57-ba6f-4ddb-9b7f-73d47a3eeeb6 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:13 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-42abca57-ba6f-4ddb-9b7f-73d47a3eeeb6 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-42abca57-ba6f-4ddb-9b7f-73d47a3eeeb6 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-42abca57-ba6f-4ddb-9b7f-73d47a3eeeb6 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-42abca57-ba6f-4ddb-9b7f-73d47a3eeeb6 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-42abca57-ba6f-4ddb-9b7f-73d47a3eeeb6 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-42abca57-ba6f-4ddb-9b7f-73d47a3eeeb6 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-42abca57-ba6f-4ddb-9b7f-73d47a3eeeb6 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-42abca57-ba6f-4ddb-9b7f-73d47a3eeeb6 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.245803 Apr 12 10:41:13 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 120/371] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 10:41:13 2023] GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5/os-interface => generated 283 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ea21d7cc-df7b-4891-9e9d-494d89110c9f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:13 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-ea21d7cc-df7b-4891-9e9d-494d89110c9f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ea21d7cc-df7b-4891-9e9d-494d89110c9f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ea21d7cc-df7b-4891-9e9d-494d89110c9f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ea21d7cc-df7b-4891-9e9d-494d89110c9f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ea21d7cc-df7b-4891-9e9d-494d89110c9f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ea21d7cc-df7b-4891-9e9d-494d89110c9f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ea21d7cc-df7b-4891-9e9d-494d89110c9f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:14 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-ea21d7cc-df7b-4891-9e9d-494d89110c9f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ea21d7cc-df7b-4891-9e9d-494d89110c9f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1723 microversion: 2.1 time: 0.450972 Apr 12 10:41:14 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 128/372] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:41:13 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1723 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:41:14 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-e3c1b5b6-aa63-4a76-b787-af6bc354b710 req-810636b9-a9df-4233-8651-81f0965cdcde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47d368e-3870-49d0-8522-a94991ec4ba5", "name": "network-vif-unplugged", "status": "completed", "tag": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e3c1b5b6-aa63-4a76-b787-af6bc354b710 req-810636b9-a9df-4233-8651-81f0965cdcde service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e3c1b5b6-aa63-4a76-b787-af6bc354b710 req-810636b9-a9df-4233-8651-81f0965cdcde service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e3c1b5b6-aa63-4a76-b787-af6bc354b710 req-810636b9-a9df-4233-8651-81f0965cdcde service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5d7971dc-afa9-4709-b871-881f8119eabe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:14 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5d7971dc-afa9-4709-b871-881f8119eabe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-e3c1b5b6-aa63-4a76-b787-af6bc354b710 req-810636b9-a9df-4233-8651-81f0965cdcde service nova] Creating event network-vif-unplugged:7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance f47d368e-3870-49d0-8522-a94991ec4ba5 on user Apr 12 10:41:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5d7971dc-afa9-4709-b871-881f8119eabe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5d7971dc-afa9-4709-b871-881f8119eabe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5d7971dc-afa9-4709-b871-881f8119eabe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5d7971dc-afa9-4709-b871-881f8119eabe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5d7971dc-afa9-4709-b871-881f8119eabe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-e3c1b5b6-aa63-4a76-b787-af6bc354b710 req-810636b9-a9df-4233-8651-81f0965cdcde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053867 Apr 12 10:41:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5d7971dc-afa9-4709-b871-881f8119eabe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:14 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 125/373] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:15 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-5d7971dc-afa9-4709-b871-881f8119eabe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5d7971dc-afa9-4709-b871-881f8119eabe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1723 microversion: 2.1 time: 0.814320 Apr 12 10:41:15 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 121/374] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:41:14 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1723 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 10:41:16 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47d368e-3870-49d0-8522-a94991ec4ba5", "tag": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c"}, {"name": "network-changed", "server_uuid": "f47d368e-3870-49d0-8522-a94991ec4ba5", "tag": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c"}, {"server_uuid": "f47d368e-3870-49d0-8522-a94991ec4ba5", "name": "network-vif-plugged", "status": "completed", "tag": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c"}, {"server_uuid": "f47d368e-3870-49d0-8522-a94991ec4ba5", "name": "network-vif-plugged", "status": "completed", "tag": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Creating event network-changed:7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance f47d368e-3870-49d0-8522-a94991ec4ba5 on user Apr 12 10:41:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Creating event network-changed:7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance f47d368e-3870-49d0-8522-a94991ec4ba5 on user Apr 12 10:41:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Creating event network-vif-plugged:7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance f47d368e-3870-49d0-8522-a94991ec4ba5 on user Apr 12 10:41:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Creating event network-vif-plugged:7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance f47d368e-3870-49d0-8522-a94991ec4ba5 on user Apr 12 10:41:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 688 microversion: 2.1 time: 0.042377 Apr 12 10:41:16 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 129/375] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:16 2023] POST /compute/v2.1/os-server-external-events => generated 688 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:16 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-ae9a9a1e-8bc2-4f55-a013-1fb7c876b5f7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:16 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-ae9a9a1e-8bc2-4f55-a013-1fb7c876b5f7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:16 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ae9a9a1e-8bc2-4f55-a013-1fb7c876b5f7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:16 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ae9a9a1e-8bc2-4f55-a013-1fb7c876b5f7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:16 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ae9a9a1e-8bc2-4f55-a013-1fb7c876b5f7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:16 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ae9a9a1e-8bc2-4f55-a013-1fb7c876b5f7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:16 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ae9a9a1e-8bc2-4f55-a013-1fb7c876b5f7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:16 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ae9a9a1e-8bc2-4f55-a013-1fb7c876b5f7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:16 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-ae9a9a1e-8bc2-4f55-a013-1fb7c876b5f7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] HTTP exception thrown: Instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 could not be found. Apr 12 10:41:16 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-ae9a9a1e-8bc2-4f55-a013-1fb7c876b5f7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Request method failure captured: Apr 12 10:41:16 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 HTTP/1.1 Apr 12 10:41:16 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:41:16 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:41:16 user devstack@n-api.service[61852]: Connection: close Apr 12 10:41:16 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:41:16 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:41:16 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:41:16 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:41:16 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:41:16 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNooKHHzpYV5ukInxPhdDWCJQPMdFxxzDjWCB-hX0gmsLNNB_zjEgoiUt5F-J7f_CQ93pPew5Ssuydcv1GDDEhZ63vVnrp8ZlqnbQo0J83C3obS8b6-kez8-pGMY3gRkg-Tg1m3dzyk4mtMX73Z2ZAPMTU2kXScLXR7uvScqRE-UPWnU Apr 12 10:41:16 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:41:16 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:41:16 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:41:16 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:41:16 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:41:16 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:41:16 user devstack@n-api.service[61852]: X-Project-Id: 16de154a6d344b18a939c6a1b1a679f5 Apr 12 10:41:16 user devstack@n-api.service[61852]: X-Project-Name: tempest-VolumesSnapshotTestJSON-858479648 Apr 12 10:41:16 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:41:16 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:41:16 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/16de154a6d344b18a939c6a1b1a679f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16de154a6d344b18a939c6a1b1a679f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16de154a6d344b18a939c6a1b1a679f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:41:16 user devstack@n-api.service[61852]: X-Tenant: tempest-VolumesSnapshotTestJSON-858479648 Apr 12 10:41:16 user devstack@n-api.service[61852]: X-Tenant-Id: 16de154a6d344b18a939c6a1b1a679f5 Apr 12 10:41:16 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-858479648 Apr 12 10:41:16 user devstack@n-api.service[61852]: X-User: tempest-VolumesSnapshotTestJSON-858479648-project-member Apr 12 10:41:16 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:41:16 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:41:16 user devstack@n-api.service[61852]: X-User-Id: 2c97c57a3e7142d088e1cf315f5d8d72 Apr 12 10:41:16 user devstack@n-api.service[61852]: X-User-Name: tempest-VolumesSnapshotTestJSON-858479648-project-member Apr 12 10:41:16 user devstack@n-api.service[61852]: method: > Apr 12 10:41:16 user devstack@n-api.service[61852]: exception: Instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 could not be found. Apr 12 10:41:16 user devstack@n-api.service[61852]: action_args: {'id': 'a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2'} Apr 12 10:41:16 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 could not be found. Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 could not be found. Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:41:16 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:41:17 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:41:17 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:41:17 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:41:17 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 could not be found. Apr 12 10:41:17 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:41:17 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-ae9a9a1e-8bc2-4f55-a013-1fb7c876b5f7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Returning 404 to user: Instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:41:17 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-ae9a9a1e-8bc2-4f55-a013-1fb7c876b5f7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" status: 404 len: 111 microversion: 2.1 time: 0.049875 Apr 12 10:41:17 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 126/376] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:41:16 2023] GET /compute/v2.1/servers/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 10:41:18 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-ffad7374-7b6b-4227-9958-ef1a2b2e83a7 req-f442cffc-e375-41d6-86c5-00dbf57a6986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47d368e-3870-49d0-8522-a94991ec4ba5", "name": "network-vif-plugged", "status": "completed", "tag": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ffad7374-7b6b-4227-9958-ef1a2b2e83a7 req-f442cffc-e375-41d6-86c5-00dbf57a6986 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ffad7374-7b6b-4227-9958-ef1a2b2e83a7 req-f442cffc-e375-41d6-86c5-00dbf57a6986 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ffad7374-7b6b-4227-9958-ef1a2b2e83a7 req-f442cffc-e375-41d6-86c5-00dbf57a6986 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:18 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-ffad7374-7b6b-4227-9958-ef1a2b2e83a7 req-f442cffc-e375-41d6-86c5-00dbf57a6986 service nova] Creating event network-vif-plugged:7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance f47d368e-3870-49d0-8522-a94991ec4ba5 on user Apr 12 10:41:18 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-ffad7374-7b6b-4227-9958-ef1a2b2e83a7 req-f442cffc-e375-41d6-86c5-00dbf57a6986 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043800 Apr 12 10:41:18 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 122/377] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1994532850", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "networks": [{"uuid": "1b1e97a6-2805-47eb-b62a-777fed79a136"}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:22 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] validate_networks() for [('1b1e97a6-2805-47eb-b62a-777fed79a136', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:41:23 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:41:23 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:41:23 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:41:23 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:41:23 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:41:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:23 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Getting quotas for project 71bb70c871154a14947ea3421553a229. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:41:23 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Getting quotas for user bccad0e37147441cb68130a22197a5d4 and project 71bb70c871154a14947ea3421553a229. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:41:23 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:41:23 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:41:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.920212 Apr 12 10:41:23 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 130/378] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:41:22 2023] POST /compute/v2.1/servers => generated 378 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:41:23 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-212e3427-757c-49f3-9613-ae69474bd839 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:23 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-212e3427-757c-49f3-9613-ae69474bd839 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:23 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-212e3427-757c-49f3-9613-ae69474bd839 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccad0e37147441cb68130a22197a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bb70c871154a14947ea3421553a229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:23 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-212e3427-757c-49f3-9613-ae69474bd839 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aec86031-be71-4a8f-a8ad-cf04c506fdb4" status: 200 len: 1208 microversion: 2.1 time: 0.086026 Apr 12 10:41:23 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 127/379] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:41:23 2023] GET /compute/v2.1/servers/aec86031-be71-4a8f-a8ad-cf04c506fdb4 => generated 1208 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:41:26 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1856542060", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "networks": [{"uuid": "a5611852-639c-4e1f-8dbc-cc88bc5651d8"}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:26 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] validate_networks() for [('a5611852-639c-4e1f-8dbc-cc88bc5651d8', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:41:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-4ee13c8a-955c-4fcc-b018-15549af12506 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:26 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-4ee13c8a-955c-4fcc-b018-15549af12506 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4ee13c8a-955c-4fcc-b018-15549af12506 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4ee13c8a-955c-4fcc-b018-15549af12506 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4ee13c8a-955c-4fcc-b018-15549af12506 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4ee13c8a-955c-4fcc-b018-15549af12506 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4ee13c8a-955c-4fcc-b018-15549af12506 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4ee13c8a-955c-4fcc-b018-15549af12506 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:26 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-4ee13c8a-955c-4fcc-b018-15549af12506 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:26 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-4ee13c8a-955c-4fcc-b018-15549af12506 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:26 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-4ee13c8a-955c-4fcc-b018-15549af12506 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-4ee13c8a-955c-4fcc-b018-15549af12506 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa" status: 200 len: 1652 microversion: 2.20 time: 0.217381 Apr 12 10:41:26 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 131/380] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:41:26 2023] GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa => generated 1652 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:41:28 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:41:28 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:41:28 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:41:28 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:41:28 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:41:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:28 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Getting quotas for project 16de154a6d344b18a939c6a1b1a679f5. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:41:28 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Getting quotas for user 2c97c57a3e7142d088e1cf315f5d8d72 and project 16de154a6d344b18a939c6a1b1a679f5. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:41:28 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:41:28 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-a2fd8a23-1112-40b6-b447-b9ec06d4a0bf req-3723d462-eeb4-41b6-8a1e-7c41bdaa5851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aec86031-be71-4a8f-a8ad-cf04c506fdb4", "tag": "ad98480a-be93-49cd-8de6-0678546d7f68"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-a2fd8a23-1112-40b6-b447-b9ec06d4a0bf req-3723d462-eeb4-41b6-8a1e-7c41bdaa5851 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-a2fd8a23-1112-40b6-b447-b9ec06d4a0bf req-3723d462-eeb4-41b6-8a1e-7c41bdaa5851 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-a2fd8a23-1112-40b6-b447-b9ec06d4a0bf req-3723d462-eeb4-41b6-8a1e-7c41bdaa5851 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:28 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:41:28 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:41:28 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-a2fd8a23-1112-40b6-b447-b9ec06d4a0bf req-3723d462-eeb4-41b6-8a1e-7c41bdaa5851 service nova] Creating event network-changed:ad98480a-be93-49cd-8de6-0678546d7f68 for instance aec86031-be71-4a8f-a8ad-cf04c506fdb4 on user Apr 12 10:41:28 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-a2fd8a23-1112-40b6-b447-b9ec06d4a0bf req-3723d462-eeb4-41b6-8a1e-7c41bdaa5851 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052269 Apr 12 10:41:28 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 128/381] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.793693 Apr 12 10:41:28 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 123/382] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:41:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:41:28 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b6438008-4480-4bb3-a16d-0f50b2d12298 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:28 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-b6438008-4480-4bb3-a16d-0f50b2d12298 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:28 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-b6438008-4480-4bb3-a16d-0f50b2d12298 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c97c57a3e7142d088e1cf315f5d8d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16de154a6d344b18a939c6a1b1a679f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:28 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b6438008-4480-4bb3-a16d-0f50b2d12298 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f834736-e836-49d3-b931-83ad82bef8f3" status: 200 len: 1213 microversion: 2.1 time: 0.118713 Apr 12 10:41:28 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 132/383] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:41:28 2023] GET /compute/v2.1/servers/7f834736-e836-49d3-b931-83ad82bef8f3 => generated 1213 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:41:28 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-48513205-749e-47ca-aacd-772928120f8c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:28 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-48513205-749e-47ca-aacd-772928120f8c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-48513205-749e-47ca-aacd-772928120f8c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-48513205-749e-47ca-aacd-772928120f8c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-48513205-749e-47ca-aacd-772928120f8c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-48513205-749e-47ca-aacd-772928120f8c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-48513205-749e-47ca-aacd-772928120f8c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-48513205-749e-47ca-aacd-772928120f8c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:28 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-48513205-749e-47ca-aacd-772928120f8c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.163549 Apr 12 10:41:28 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 129/384] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 10:41:28 2023] GET /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8/os-interface => generated 1829 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:41:29 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-667e8630-fb4e-400b-9c71-0659e2110d43 req-6d371543-d73b-4508-843d-89f46b6b369d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "tag": "daf1aa56-7b24-4f41-93fd-a54cdf96428f"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-667e8630-fb4e-400b-9c71-0659e2110d43 req-6d371543-d73b-4508-843d-89f46b6b369d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-667e8630-fb4e-400b-9c71-0659e2110d43 req-6d371543-d73b-4508-843d-89f46b6b369d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-667e8630-fb4e-400b-9c71-0659e2110d43 req-6d371543-d73b-4508-843d-89f46b6b369d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-667e8630-fb4e-400b-9c71-0659e2110d43 req-6d371543-d73b-4508-843d-89f46b6b369d service nova] Creating event network-changed:daf1aa56-7b24-4f41-93fd-a54cdf96428f for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-667e8630-fb4e-400b-9c71-0659e2110d43 req-6d371543-d73b-4508-843d-89f46b6b369d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048089 Apr 12 10:41:29 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 124/385] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:29 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0e6ff3ef-f87b-4c75-bd97-5f3ae72441b3 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:29 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-0e6ff3ef-f87b-4c75-bd97-5f3ae72441b3 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0e6ff3ef-f87b-4c75-bd97-5f3ae72441b3 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0e6ff3ef-f87b-4c75-bd97-5f3ae72441b3 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0e6ff3ef-f87b-4c75-bd97-5f3ae72441b3 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0e6ff3ef-f87b-4c75-bd97-5f3ae72441b3 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0e6ff3ef-f87b-4c75-bd97-5f3ae72441b3 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0e6ff3ef-f87b-4c75-bd97-5f3ae72441b3 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:30 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-0e6ff3ef-f87b-4c75-bd97-5f3ae72441b3 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21034326c41f487181d19f60e0ccf219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ec9852adb94a5086dc3ef48871d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:30 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-0e6ff3ef-f87b-4c75-bd97-5f3ae72441b3 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21034326c41f487181d19f60e0ccf219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ec9852adb94a5086dc3ef48871d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:30 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-0e6ff3ef-f87b-4c75-bd97-5f3ae72441b3 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21034326c41f487181d19f60e0ccf219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ec9852adb94a5086dc3ef48871d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-0e6ff3ef-f87b-4c75-bd97-5f3ae72441b3 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8" status: 200 len: 2824 microversion: 2.32 time: 0.486592 Apr 12 10:41:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 133/386] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:41:29 2023] GET /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8 => generated 2824 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:41:30 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-98fe5013-ceb4-4ef8-a6a4-edf5cff6efc7 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:30 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-98fe5013-ceb4-4ef8-a6a4-edf5cff6efc7 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:30 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-98fe5013-ceb4-4ef8-a6a4-edf5cff6efc7 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:30 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-98fe5013-ceb4-4ef8-a6a4-edf5cff6efc7 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:30 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-98fe5013-ceb4-4ef8-a6a4-edf5cff6efc7 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:30 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-98fe5013-ceb4-4ef8-a6a4-edf5cff6efc7 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:30 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-98fe5013-ceb4-4ef8-a6a4-edf5cff6efc7 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:30 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-98fe5013-ceb4-4ef8-a6a4-edf5cff6efc7 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:30 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-98fe5013-ceb4-4ef8-a6a4-edf5cff6efc7 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.196896 Apr 12 10:41:30 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 130/387] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 10:41:30 2023] GET /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8/os-interface => generated 1829 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:41:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-264d1ff6-e116-404c-9c7f-043b39f7fe76 req-d0a1f13a-a1fb-4b76-93a4-9c91f53721f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec86031-be71-4a8f-a8ad-cf04c506fdb4", "name": "network-vif-plugged", "status": "completed", "tag": "ad98480a-be93-49cd-8de6-0678546d7f68"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-264d1ff6-e116-404c-9c7f-043b39f7fe76 req-d0a1f13a-a1fb-4b76-93a4-9c91f53721f2 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-264d1ff6-e116-404c-9c7f-043b39f7fe76 req-d0a1f13a-a1fb-4b76-93a4-9c91f53721f2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-264d1ff6-e116-404c-9c7f-043b39f7fe76 req-d0a1f13a-a1fb-4b76-93a4-9c91f53721f2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5d289824-b03c-4c79-b8e3-d7a3a2e3956b tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Action: 'create', calling method: .version_select at 0x7fabbf7b2b00>, body: {"keypair": {"name": "tempest-TestShelveInstance-577615131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOk2UPAom5CjZdHfplY6HjUNzNcB4NEAH+k/X71Ve1S4CsmjYhLiu/vz+zIBK/KpJ2uQiNOTfsgNS8zhPMGpKrvMmQM5PVNKr7l+PqrgS24giNXUhI2aB8tdrnYrhcS2EQ=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-264d1ff6-e116-404c-9c7f-043b39f7fe76 req-d0a1f13a-a1fb-4b76-93a4-9c91f53721f2 service nova] Creating event network-vif-plugged:ad98480a-be93-49cd-8de6-0678546d7f68 for instance aec86031-be71-4a8f-a8ad-cf04c506fdb4 on user Apr 12 10:41:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-264d1ff6-e116-404c-9c7f-043b39f7fe76 req-d0a1f13a-a1fb-4b76-93a4-9c91f53721f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041712 Apr 12 10:41:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 134/388] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:31 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-5d289824-b03c-4c79-b8e3-d7a3a2e3956b tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Getting quotas for project 90ef7aa45de34b01a97b6bc5e0acece5. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:41:31 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-5d289824-b03c-4c79-b8e3-d7a3a2e3956b tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Getting quotas for user 574af27cae41457c9be3d5d50d347b27 and project 90ef7aa45de34b01a97b6bc5e0acece5. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:41:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-34d3e2cd-1870-4442-ad84-1226cd86625e req-b2e74b39-c8b8-419b-a44b-d4813a1c5acd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f834736-e836-49d3-b931-83ad82bef8f3", "tag": "28905d4a-0e25-4d67-bab4-ee310dd9eea8"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-34d3e2cd-1870-4442-ad84-1226cd86625e req-b2e74b39-c8b8-419b-a44b-d4813a1c5acd service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-34d3e2cd-1870-4442-ad84-1226cd86625e req-b2e74b39-c8b8-419b-a44b-d4813a1c5acd service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-34d3e2cd-1870-4442-ad84-1226cd86625e req-b2e74b39-c8b8-419b-a44b-d4813a1c5acd service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5d289824-b03c-4c79-b8e3-d7a3a2e3956b tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.275556 Apr 12 10:41:31 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 125/389] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 10:41:31 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-34d3e2cd-1870-4442-ad84-1226cd86625e req-b2e74b39-c8b8-419b-a44b-d4813a1c5acd service nova] Creating event network-changed:28905d4a-0e25-4d67-bab4-ee310dd9eea8 for instance 7f834736-e836-49d3-b931-83ad82bef8f3 on user Apr 12 10:41:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-34d3e2cd-1870-4442-ad84-1226cd86625e req-b2e74b39-c8b8-419b-a44b-d4813a1c5acd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047117 Apr 12 10:41:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 135/390] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:41:31 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-75b9ced4-9234-4b60-83d3-45cc1544069b tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:31 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-75b9ced4-9234-4b60-83d3-45cc1544069b tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:31 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-75b9ced4-9234-4b60-83d3-45cc1544069b tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:31 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-75b9ced4-9234-4b60-83d3-45cc1544069b tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:31 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-75b9ced4-9234-4b60-83d3-45cc1544069b tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:31 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-75b9ced4-9234-4b60-83d3-45cc1544069b tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:31 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-75b9ced4-9234-4b60-83d3-45cc1544069b tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:31 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-75b9ced4-9234-4b60-83d3-45cc1544069b tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:31 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-75b9ced4-9234-4b60-83d3-45cc1544069b tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] HTTP exception thrown: Instance 1c663163-6794-4c92-a401-5bc15d112c65 could not be found. Apr 12 10:41:31 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-75b9ced4-9234-4b60-83d3-45cc1544069b tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Request method failure captured: Apr 12 10:41:31 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/1c663163-6794-4c92-a401-5bc15d112c65 HTTP/1.1 Apr 12 10:41:31 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:41:31 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:41:31 user devstack@n-api.service[61852]: Connection: close Apr 12 10:41:31 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:41:31 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:41:31 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:41:31 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:41:31 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:41:31 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNoluO1Bm_H-4gYbVuTcOPouBpPsKzP78vf4zWH6PD6P2phNHKvGPcw06MkSndMUAyin7ZkyZ9sQ2OChSJFu6ASJVQlfNmI9B3ZxwY4LrHmJNJi7xcLcqpM2BF0_wqfDECe5brSyDrqpcn6EZq_ZoyIlNHRIfrpRZZsQr_J9fA6Qxoqg Apr 12 10:41:31 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:41:31 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:41:31 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:41:31 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:41:31 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:41:31 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:41:31 user devstack@n-api.service[61852]: X-Project-Id: 0cdb8217b1544db384bebe1059848bb6 Apr 12 10:41:31 user devstack@n-api.service[61852]: X-Project-Name: tempest-VolumesAdminNegativeTest-375460860 Apr 12 10:41:31 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:41:31 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:41:31 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0cdb8217b1544db384bebe1059848bb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0cdb8217b1544db384bebe1059848bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0cdb8217b1544db384bebe1059848bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:41:31 user devstack@n-api.service[61852]: X-Tenant: tempest-VolumesAdminNegativeTest-375460860 Apr 12 10:41:31 user devstack@n-api.service[61852]: X-Tenant-Id: 0cdb8217b1544db384bebe1059848bb6 Apr 12 10:41:31 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-375460860 Apr 12 10:41:31 user devstack@n-api.service[61852]: X-User: tempest-VolumesAdminNegativeTest-375460860-project-member Apr 12 10:41:31 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:41:31 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:41:31 user devstack@n-api.service[61852]: X-User-Id: a0a2243c6c9f431da846cc54ec181fcc Apr 12 10:41:31 user devstack@n-api.service[61852]: X-User-Name: tempest-VolumesAdminNegativeTest-375460860-project-member Apr 12 10:41:31 user devstack@n-api.service[61852]: method: > Apr 12 10:41:31 user devstack@n-api.service[61852]: exception: Instance 1c663163-6794-4c92-a401-5bc15d112c65 could not be found. Apr 12 10:41:31 user devstack@n-api.service[61852]: action_args: {'id': '1c663163-6794-4c92-a401-5bc15d112c65'} Apr 12 10:41:31 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c663163-6794-4c92-a401-5bc15d112c65 could not be found. Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c663163-6794-4c92-a401-5bc15d112c65 could not be found. Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c663163-6794-4c92-a401-5bc15d112c65 could not be found. Apr 12 10:41:31 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:41:31 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-75b9ced4-9234-4b60-83d3-45cc1544069b tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Returning 404 to user: Instance 1c663163-6794-4c92-a401-5bc15d112c65 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:41:31 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-75b9ced4-9234-4b60-83d3-45cc1544069b tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c663163-6794-4c92-a401-5bc15d112c65" status: 404 len: 111 microversion: 2.1 time: 0.182595 Apr 12 10:41:31 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 131/391] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:41:31 2023] GET /compute/v2.1/servers/1c663163-6794-4c92-a401-5bc15d112c65 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:41:32 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:32 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:32 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:41:32 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8" status: 204 len: 0 microversion: 2.32 time: 0.150332 Apr 12 10:41:32 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 126/392] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 10:41:32 2023] DELETE /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 10:41:32 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ae228824-7649-4bd4-b7a6-1a03c1e65b7c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:32 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-ae228824-7649-4bd4-b7a6-1a03c1e65b7c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ae228824-7649-4bd4-b7a6-1a03c1e65b7c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ae228824-7649-4bd4-b7a6-1a03c1e65b7c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ae228824-7649-4bd4-b7a6-1a03c1e65b7c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ae228824-7649-4bd4-b7a6-1a03c1e65b7c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ae228824-7649-4bd4-b7a6-1a03c1e65b7c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ae228824-7649-4bd4-b7a6-1a03c1e65b7c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:32 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-ae228824-7649-4bd4-b7a6-1a03c1e65b7c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21034326c41f487181d19f60e0ccf219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ec9852adb94a5086dc3ef48871d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:32 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-ae228824-7649-4bd4-b7a6-1a03c1e65b7c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21034326c41f487181d19f60e0ccf219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ec9852adb94a5086dc3ef48871d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:32 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-ae228824-7649-4bd4-b7a6-1a03c1e65b7c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21034326c41f487181d19f60e0ccf219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ec9852adb94a5086dc3ef48871d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:32 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ae228824-7649-4bd4-b7a6-1a03c1e65b7c tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8" status: 200 len: 2949 microversion: 2.32 time: 0.481472 Apr 12 10:41:32 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 136/393] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:41:32 2023] GET /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8 => generated 2949 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:41:32 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-9aa3c33e-452b-494b-a503-7057085a4314 req-eeab5459-5d52-4ddb-9408-5fd71682d8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-unplugged", "status": "completed", "tag": "daf1aa56-7b24-4f41-93fd-a54cdf96428f"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-9aa3c33e-452b-494b-a503-7057085a4314 req-eeab5459-5d52-4ddb-9408-5fd71682d8dd service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-9aa3c33e-452b-494b-a503-7057085a4314 req-eeab5459-5d52-4ddb-9408-5fd71682d8dd service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-9aa3c33e-452b-494b-a503-7057085a4314 req-eeab5459-5d52-4ddb-9408-5fd71682d8dd service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:33 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-9aa3c33e-452b-494b-a503-7057085a4314 req-eeab5459-5d52-4ddb-9408-5fd71682d8dd service nova] Creating event network-vif-unplugged:daf1aa56-7b24-4f41-93fd-a54cdf96428f for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:33 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-9aa3c33e-452b-494b-a503-7057085a4314 req-eeab5459-5d52-4ddb-9408-5fd71682d8dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.178566 Apr 12 10:41:33 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 132/394] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:33 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec86031-be71-4a8f-a8ad-cf04c506fdb4", "name": "network-vif-plugged", "status": "completed", "tag": "ad98480a-be93-49cd-8de6-0678546d7f68"}, {"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-unplugged", "status": "completed", "tag": "825c6036-d16c-43ab-9f6a-2bb133bf51b8"}, {"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "825c6036-d16c-43ab-9f6a-2bb133bf51b8"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:33 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] Creating event network-vif-plugged:ad98480a-be93-49cd-8de6-0678546d7f68 for instance aec86031-be71-4a8f-a8ad-cf04c506fdb4 on user Apr 12 10:41:33 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] Creating event network-vif-unplugged:825c6036-d16c-43ab-9f6a-2bb133bf51b8 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:33 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] Creating event network-vif-plugged:825c6036-d16c-43ab-9f6a-2bb133bf51b8 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:33 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-5bb63fb6-28bd-4c4d-bae9-d1c49e037583 req-a7328570-2d76-4d82-b030-e23d1b0fda84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-unplugged", "status": "completed", "tag": "fb79e431-1d99-40eb-94a0-20032fa213fb"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:33 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.068330 Apr 12 10:41:33 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:41:33 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 127/395] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:33 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5bb63fb6-28bd-4c4d-bae9-d1c49e037583 req-a7328570-2d76-4d82-b030-e23d1b0fda84 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5bb63fb6-28bd-4c4d-bae9-d1c49e037583 req-a7328570-2d76-4d82-b030-e23d1b0fda84 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5bb63fb6-28bd-4c4d-bae9-d1c49e037583 req-a7328570-2d76-4d82-b030-e23d1b0fda84 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:33 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-5bb63fb6-28bd-4c4d-bae9-d1c49e037583 req-a7328570-2d76-4d82-b030-e23d1b0fda84 service nova] Creating event network-vif-unplugged:fb79e431-1d99-40eb-94a0-20032fa213fb for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:33 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-5bb63fb6-28bd-4c4d-bae9-d1c49e037583 req-a7328570-2d76-4d82-b030-e23d1b0fda84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049060 Apr 12 10:41:33 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 137/396] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:35 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:41:35 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "daf1aa56-7b24-4f41-93fd-a54cdf96428f"}, {"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-unplugged", "status": "completed", "tag": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7"}, {"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7"}, {"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-unplugged", "status": "completed", "tag": "e16e56f7-00ab-422d-95b3-d1b204f693a3"}, {"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "e16e56f7-00ab-422d-95b3-d1b204f693a3"}, {"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-unplugged", "status": "completed", "tag": "3c8cf480-05d6-463a-a97e-a9d869ac3860"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:35 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=25 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:41:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Creating event network-vif-plugged:daf1aa56-7b24-4f41-93fd-a54cdf96428f for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Creating event network-vif-unplugged:bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Creating event network-vif-plugged:bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Creating event network-vif-unplugged:e16e56f7-00ab-422d-95b3-d1b204f693a3 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Creating event network-vif-plugged:e16e56f7-00ab-422d-95b3-d1b204f693a3 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Creating event network-vif-unplugged:3c8cf480-05d6-463a-a97e-a9d869ac3860 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1044 microversion: 2.1 time: 0.050295 Apr 12 10:41:35 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 133/397] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:35 2023] POST /compute/v2.1/os-server-external-events => generated 1044 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:41:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:35 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:35 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:41:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30" status: 204 len: 0 microversion: 2.1 time: 0.182461 Apr 12 10:41:35 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 128/398] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:41:35 2023] DELETE /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:41:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6784fea9-f573-4b2d-b925-23895b93dff4 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:35 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-6784fea9-f573-4b2d-b925-23895b93dff4 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6784fea9-f573-4b2d-b925-23895b93dff4 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6784fea9-f573-4b2d-b925-23895b93dff4 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6784fea9-f573-4b2d-b925-23895b93dff4 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6784fea9-f573-4b2d-b925-23895b93dff4 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6784fea9-f573-4b2d-b925-23895b93dff4 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6784fea9-f573-4b2d-b925-23895b93dff4 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:35 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-6784fea9-f573-4b2d-b925-23895b93dff4 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a2243c6c9f431da846cc54ec181fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb8217b1544db384bebe1059848bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-6784fea9-f573-4b2d-b925-23895b93dff4 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30" status: 200 len: 1669 microversion: 2.1 time: 0.367297 Apr 12 10:41:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 138/399] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:41:35 2023] GET /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30 => generated 1669 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 10:41:35 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "fb79e431-1d99-40eb-94a0-20032fa213fb"}, {"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-unplugged", "status": "completed", "tag": "13923b13-db35-4b98-b2b0-e2e18fd8441e"}, {"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "13923b13-db35-4b98-b2b0-e2e18fd8441e"}, {"server_uuid": "7f834736-e836-49d3-b931-83ad82bef8f3", "name": "network-vif-plugged", "status": "completed", "tag": "28905d4a-0e25-4d67-bab4-ee310dd9eea8"}, {"server_uuid": "7f834736-e836-49d3-b931-83ad82bef8f3", "name": "network-vif-plugged", "status": "completed", "tag": "28905d4a-0e25-4d67-bab4-ee310dd9eea8"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Creating event network-vif-plugged:fb79e431-1d99-40eb-94a0-20032fa213fb for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Creating event network-vif-unplugged:13923b13-db35-4b98-b2b0-e2e18fd8441e for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Creating event network-vif-plugged:13923b13-db35-4b98-b2b0-e2e18fd8441e for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Creating event network-vif-plugged:28905d4a-0e25-4d67-bab4-ee310dd9eea8 for instance 7f834736-e836-49d3-b931-83ad82bef8f3 on user Apr 12 10:41:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Creating event network-vif-plugged:28905d4a-0e25-4d67-bab4-ee310dd9eea8 for instance 7f834736-e836-49d3-b931-83ad82bef8f3 on user Apr 12 10:41:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.051871 Apr 12 10:41:35 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 134/400] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:35 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:37 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-plugged", "status": "completed", "tag": "3c8cf480-05d6-463a-a97e-a9d869ac3860"}, {"server_uuid": "d04cb526-f77a-457c-90b1-3e5c202c0c30", "name": "network-vif-unplugged", "status": "completed", "tag": "d6cd169f-f736-45da-96ea-c0b933c882a0"}, {"server_uuid": "d04cb526-f77a-457c-90b1-3e5c202c0c30", "name": "network-vif-plugged", "status": "completed", "tag": "d6cd169f-f736-45da-96ea-c0b933c882a0"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] Creating event network-vif-plugged:3c8cf480-05d6-463a-a97e-a9d869ac3860 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] Creating event network-vif-unplugged:d6cd169f-f736-45da-96ea-c0b933c882a0 for instance d04cb526-f77a-457c-90b1-3e5c202c0c30 on user Apr 12 10:41:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] Creating event network-vif-plugged:d6cd169f-f736-45da-96ea-c0b933c882a0 for instance d04cb526-f77a-457c-90b1-3e5c202c0c30 on user Apr 12 10:41:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.050432 Apr 12 10:41:37 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 129/401] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:37 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-9a5c98b7-4f35-477f-81db-0ece2745d69d req-05e91a66-7b4d-424a-be81-c8b45b3d79f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d04cb526-f77a-457c-90b1-3e5c202c0c30", "name": "network-vif-deleted", "tag": "d6cd169f-f736-45da-96ea-c0b933c882a0"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:38 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:41:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9a5c98b7-4f35-477f-81db-0ece2745d69d req-05e91a66-7b4d-424a-be81-c8b45b3d79f3 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9a5c98b7-4f35-477f-81db-0ece2745d69d req-05e91a66-7b4d-424a-be81-c8b45b3d79f3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9a5c98b7-4f35-477f-81db-0ece2745d69d req-05e91a66-7b4d-424a-be81-c8b45b3d79f3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:38 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=47 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:41:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-9a5c98b7-4f35-477f-81db-0ece2745d69d req-05e91a66-7b4d-424a-be81-c8b45b3d79f3 service nova] Creating event network-vif-deleted:d6cd169f-f736-45da-96ea-c0b933c882a0 for instance d04cb526-f77a-457c-90b1-3e5c202c0c30 on user Apr 12 10:41:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-9a5c98b7-4f35-477f-81db-0ece2745d69d req-05e91a66-7b4d-424a-be81-c8b45b3d79f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036931 Apr 12 10:41:38 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 139/402] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:38 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1222922378", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-577615131", "security_groups": [{"name": "tempest-secgroup-smoke-1477019502"}], "networks": [{"uuid": "f87563f2-62e3-4d56-b03a-0a830493f69b"}], "block_device_mapping_v2": [{"uuid": "e6850f05-a7ca-4a81-ad02-a1e4d506702b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:38 user devstack@n-api.service[61852]: DEBUG nova.network.neutron [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] validate_networks() for [('f87563f2-62e3-4d56-b03a-0a830493f69b', None, None, None, None, None)] {{(pid=61852) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:41:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-1bf44835-8b23-4b66-b58f-0b45a747a149 req-3191624a-41f4-42d7-ba32-6776dfc92bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-deleted", "tag": "daf1aa56-7b24-4f41-93fd-a54cdf96428f"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:39 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:41:39 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:41:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1bf44835-8b23-4b66-b58f-0b45a747a149 req-3191624a-41f4-42d7-ba32-6776dfc92bc7 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1bf44835-8b23-4b66-b58f-0b45a747a149 req-3191624a-41f4-42d7-ba32-6776dfc92bc7 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1bf44835-8b23-4b66-b58f-0b45a747a149 req-3191624a-41f4-42d7-ba32-6776dfc92bc7 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:39 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:41:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-1bf44835-8b23-4b66-b58f-0b45a747a149 req-3191624a-41f4-42d7-ba32-6776dfc92bc7 service nova] Creating event network-vif-deleted:daf1aa56-7b24-4f41-93fd-a54cdf96428f for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-1bf44835-8b23-4b66-b58f-0b45a747a149 req-3191624a-41f4-42d7-ba32-6776dfc92bc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049771 Apr 12 10:41:39 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 130/403] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:39 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Flavor limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:41:39 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Image limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:41:39 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Flavor pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:41:39 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Image pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:41:39 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:41:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:39 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Getting quotas for project 90ef7aa45de34b01a97b6bc5e0acece5. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:41:39 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Getting quotas for user 574af27cae41457c9be3d5d50d347b27 and project 90ef7aa45de34b01a97b6bc5e0acece5. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:41:39 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Going to run 1 instances... {{(pid=61852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:41:39 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e6850f05-a7ca-4a81-ad02-a1e4d506702b',volume_size=None,volume_type=None)] {{(pid=61852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:41:39 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.148883 Apr 12 10:41:39 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 135/404] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:41:38 2023] POST /compute/v2.1/servers => generated 404 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 12 10:41:39 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-39722958-3a34-4cc4-85c1-b048eeb1bed2 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:39 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-39722958-3a34-4cc4-85c1-b048eeb1bed2 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:39 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=8 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:41:40 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-39722958-3a34-4cc4-85c1-b048eeb1bed2 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574af27cae41457c9be3d5d50d347b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef7aa45de34b01a97b6bc5e0acece5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:41:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-39722958-3a34-4cc4-85c1-b048eeb1bed2 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e" status: 200 len: 1083 microversion: 2.1 time: 0.140857 Apr 12 10:41:40 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 140/405] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:41:39 2023] GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e => generated 1083 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:41:41 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-deleted", "tag": "13923b13-db35-4b98-b2b0-e2e18fd8441e"}, {"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-deleted", "tag": "3c8cf480-05d6-463a-a97e-a9d869ac3860"}, {"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-deleted", "tag": "fb79e431-1d99-40eb-94a0-20032fa213fb"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] Creating event network-vif-deleted:13923b13-db35-4b98-b2b0-e2e18fd8441e for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] Creating event network-vif-deleted:3c8cf480-05d6-463a-a97e-a9d869ac3860 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] Creating event network-vif-deleted:fb79e431-1d99-40eb-94a0-20032fa213fb for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.077360 Apr 12 10:41:41 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 131/406] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:41 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:42 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-0a794ae9-90d7-4d62-a079-98af9245f78d req-2076f12c-0020-4da4-abec-d03bb795a5fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b29390-867e-4bf3-bc93-b401f32b130e", "tag": "78a8426a-653a-44cb-80b7-8a8b14d78cf4"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-0a794ae9-90d7-4d62-a079-98af9245f78d req-2076f12c-0020-4da4-abec-d03bb795a5fc service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-0a794ae9-90d7-4d62-a079-98af9245f78d req-2076f12c-0020-4da4-abec-d03bb795a5fc service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-0a794ae9-90d7-4d62-a079-98af9245f78d req-2076f12c-0020-4da4-abec-d03bb795a5fc service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:42 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-0a794ae9-90d7-4d62-a079-98af9245f78d req-2076f12c-0020-4da4-abec-d03bb795a5fc service nova] Creating event network-changed:78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance 68b29390-867e-4bf3-bc93-b401f32b130e on user Apr 12 10:41:42 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-0a794ae9-90d7-4d62-a079-98af9245f78d req-2076f12c-0020-4da4-abec-d03bb795a5fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037428 Apr 12 10:41:42 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 136/407] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:43 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-64be0430-5155-4481-ab2f-ae0723255347 req-16c242b9-53d9-4aeb-9b87-924887081e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b152adb-ca3d-45cf-a394-5ba5b36180a8", "name": "network-vif-deleted", "tag": "825c6036-d16c-43ab-9f6a-2bb133bf51b8"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:43 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-64be0430-5155-4481-ab2f-ae0723255347 req-16c242b9-53d9-4aeb-9b87-924887081e9f service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:43 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-64be0430-5155-4481-ab2f-ae0723255347 req-16c242b9-53d9-4aeb-9b87-924887081e9f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:43 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-64be0430-5155-4481-ab2f-ae0723255347 req-16c242b9-53d9-4aeb-9b87-924887081e9f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:43 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-64be0430-5155-4481-ab2f-ae0723255347 req-16c242b9-53d9-4aeb-9b87-924887081e9f service nova] Creating event network-vif-deleted:825c6036-d16c-43ab-9f6a-2bb133bf51b8 for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 on user Apr 12 10:41:43 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-64be0430-5155-4481-ab2f-ae0723255347 req-16c242b9-53d9-4aeb-9b87-924887081e9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036361 Apr 12 10:41:43 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 141/408] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:46 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=10 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:41:46 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:46 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:46 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lazy-loading 'services' on Instance uuid f47d368e-3870-49d0-8522-a94991ec4ba5 {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:41:46 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5/os-volume_attachments/afb7485e-496d-4fb9-a5b1-613d21171666" status: 202 len: 0 microversion: 2.1 time: 0.193354 Apr 12 10:41:46 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 132/409] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 10:41:46 2023] DELETE /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5/os-volume_attachments/afb7485e-496d-4fb9-a5b1-613d21171666 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:41:46 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-4ae81f53-a5ac-4653-996d-fe34829ec4a6 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:41:46 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-4ae81f53-a5ac-4653-996d-fe34829ec4a6 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:41:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4ae81f53-a5ac-4653-996d-fe34829ec4a6 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4ae81f53-a5ac-4653-996d-fe34829ec4a6 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4ae81f53-a5ac-4653-996d-fe34829ec4a6 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4ae81f53-a5ac-4653-996d-fe34829ec4a6 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4ae81f53-a5ac-4653-996d-fe34829ec4a6 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4ae81f53-a5ac-4653-996d-fe34829ec4a6 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-4ae81f53-a5ac-4653-996d-fe34829ec4a6 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049414 Apr 12 10:41:46 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 137/410] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:41:46 2023] GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:49 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-c5381229-c07e-4187-b4e0-682c2d401f88 req-cc1675f0-5c24-4430-91b8-c8d5311e4310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b29390-867e-4bf3-bc93-b401f32b130e", "name": "network-vif-plugged", "status": "completed", "tag": "78a8426a-653a-44cb-80b7-8a8b14d78cf4"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c5381229-c07e-4187-b4e0-682c2d401f88 req-cc1675f0-5c24-4430-91b8-c8d5311e4310 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c5381229-c07e-4187-b4e0-682c2d401f88 req-cc1675f0-5c24-4430-91b8-c8d5311e4310 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c5381229-c07e-4187-b4e0-682c2d401f88 req-cc1675f0-5c24-4430-91b8-c8d5311e4310 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:49 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-c5381229-c07e-4187-b4e0-682c2d401f88 req-cc1675f0-5c24-4430-91b8-c8d5311e4310 service nova] Creating event network-vif-plugged:78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance 68b29390-867e-4bf3-bc93-b401f32b130e on user Apr 12 10:41:49 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-c5381229-c07e-4187-b4e0-682c2d401f88 req-cc1675f0-5c24-4430-91b8-c8d5311e4310 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046738 Apr 12 10:41:49 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 142/411] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:41:51 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-26571ed8-2534-4a71-ba77-13b6328224c7 req-fec72ec3-a0ca-4691-85ec-fc29e4f2b608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b29390-867e-4bf3-bc93-b401f32b130e", "name": "network-vif-plugged", "status": "completed", "tag": "78a8426a-653a-44cb-80b7-8a8b14d78cf4"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:41:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-26571ed8-2534-4a71-ba77-13b6328224c7 req-fec72ec3-a0ca-4691-85ec-fc29e4f2b608 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:41:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-26571ed8-2534-4a71-ba77-13b6328224c7 req-fec72ec3-a0ca-4691-85ec-fc29e4f2b608 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:41:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-26571ed8-2534-4a71-ba77-13b6328224c7 req-fec72ec3-a0ca-4691-85ec-fc29e4f2b608 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:41:51 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-26571ed8-2534-4a71-ba77-13b6328224c7 req-fec72ec3-a0ca-4691-85ec-fc29e4f2b608 service nova] Creating event network-vif-plugged:78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance 68b29390-867e-4bf3-bc93-b401f32b130e on user Apr 12 10:41:51 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-26571ed8-2534-4a71-ba77-13b6328224c7 req-fec72ec3-a0ca-4691-85ec-fc29e4f2b608 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033317 Apr 12 10:41:51 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 133/412] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:41:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:42:05 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-ad504e38-508a-4e77-bb04-32f947a20d2b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:05 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-ad504e38-508a-4e77-bb04-32f947a20d2b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:05 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:42:05 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:42:05 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:42:05 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=28 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:42:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ad504e38-508a-4e77-bb04-32f947a20d2b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ad504e38-508a-4e77-bb04-32f947a20d2b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ad504e38-508a-4e77-bb04-32f947a20d2b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ad504e38-508a-4e77-bb04-32f947a20d2b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ad504e38-508a-4e77-bb04-32f947a20d2b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ad504e38-508a-4e77-bb04-32f947a20d2b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:05 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-ad504e38-508a-4e77-bb04-32f947a20d2b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/action" status: 202 len: 0 microversion: 2.87 time: 0.082614 Apr 12 10:42:05 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 138/413] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 10:42:05 2023] POST /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:42:05 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:42:05 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=9 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:42:05 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=5 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:42:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-fa4f3bea-65f0-480f-9e3b-11a40682d058 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:05 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-fa4f3bea-65f0-480f-9e3b-11a40682d058 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fa4f3bea-65f0-480f-9e3b-11a40682d058 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fa4f3bea-65f0-480f-9e3b-11a40682d058 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fa4f3bea-65f0-480f-9e3b-11a40682d058 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fa4f3bea-65f0-480f-9e3b-11a40682d058 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fa4f3bea-65f0-480f-9e3b-11a40682d058 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-fa4f3bea-65f0-480f-9e3b-11a40682d058 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:05 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-fa4f3bea-65f0-480f-9e3b-11a40682d058 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:42:05 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-fa4f3bea-65f0-480f-9e3b-11a40682d058 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:42:05 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-fa4f3bea-65f0-480f-9e3b-11a40682d058 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:42:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-fa4f3bea-65f0-480f-9e3b-11a40682d058 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" status: 200 len: 1761 microversion: 2.87 time: 0.166286 Apr 12 10:42:05 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 143/414] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:42:05 2023] GET /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 => generated 1761 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:42:05 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=7 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:42:05 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:42:05 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-0647716e-1462-4783-a6c6-ac3fb8938f92 req-a7846b4b-5152-46ce-9b0c-a7782526c7ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212", "name": "network-vif-unplugged", "status": "completed", "tag": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0647716e-1462-4783-a6c6-ac3fb8938f92 req-a7846b4b-5152-46ce-9b0c-a7782526c7ec service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0647716e-1462-4783-a6c6-ac3fb8938f92 req-a7846b4b-5152-46ce-9b0c-a7782526c7ec service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0647716e-1462-4783-a6c6-ac3fb8938f92 req-a7846b4b-5152-46ce-9b0c-a7782526c7ec service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-0647716e-1462-4783-a6c6-ac3fb8938f92 req-a7846b4b-5152-46ce-9b0c-a7782526c7ec service nova] Creating event network-vif-unplugged:1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 on user Apr 12 10:42:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-0647716e-1462-4783-a6c6-ac3fb8938f92 req-a7846b4b-5152-46ce-9b0c-a7782526c7ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037913 Apr 12 10:42:05 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 134/415] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:42:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:42:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-c5df4188-8535-4231-9c76-346d6fb4bfcd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:07 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-c5df4188-8535-4231-9c76-346d6fb4bfcd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c5df4188-8535-4231-9c76-346d6fb4bfcd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c5df4188-8535-4231-9c76-346d6fb4bfcd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c5df4188-8535-4231-9c76-346d6fb4bfcd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c5df4188-8535-4231-9c76-346d6fb4bfcd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c5df4188-8535-4231-9c76-346d6fb4bfcd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c5df4188-8535-4231-9c76-346d6fb4bfcd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:07 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-c5df4188-8535-4231-9c76-346d6fb4bfcd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d19bfc4894401cb664521438338b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024682bfda5548b8b9b404c85dd55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:42:07 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-c5df4188-8535-4231-9c76-346d6fb4bfcd tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586" status: 200 len: 1492 microversion: 2.1 time: 0.155504 Apr 12 10:42:07 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 139/416] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:42:07 2023] GET /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586 => generated 1492 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:42:07 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212", "name": "network-vif-plugged", "status": "completed", "tag": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb"}, {"server_uuid": "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212", "name": "network-vif-plugged", "status": "completed", "tag": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:07 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:07 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] Creating event network-vif-plugged:1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 on user Apr 12 10:42:07 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] Creating event network-vif-plugged:1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 on user Apr 12 10:42:07 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031582 Apr 12 10:42:07 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 144/417] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:42:07 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:42:09 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-e5308045-8750-4f49-b232-9a72509f566b req-6714d7ee-2851-43bc-b314-80e4eb97527b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212", "name": "network-vif-plugged", "status": "completed", "tag": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e5308045-8750-4f49-b232-9a72509f566b req-6714d7ee-2851-43bc-b314-80e4eb97527b service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e5308045-8750-4f49-b232-9a72509f566b req-6714d7ee-2851-43bc-b314-80e4eb97527b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e5308045-8750-4f49-b232-9a72509f566b req-6714d7ee-2851-43bc-b314-80e4eb97527b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e5308045-8750-4f49-b232-9a72509f566b req-6714d7ee-2851-43bc-b314-80e4eb97527b service nova] Creating event network-vif-plugged:1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 on user Apr 12 10:42:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-e5308045-8750-4f49-b232-9a72509f566b req-6714d7ee-2851-43bc-b314-80e4eb97527b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033140 Apr 12 10:42:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 135/418] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:42:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:42:13 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-78e03013-3283-47a1-a9a3-1431c6eb019a tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:13 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-78e03013-3283-47a1-a9a3-1431c6eb019a tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-78e03013-3283-47a1-a9a3-1431c6eb019a tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-78e03013-3283-47a1-a9a3-1431c6eb019a tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-78e03013-3283-47a1-a9a3-1431c6eb019a tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-78e03013-3283-47a1-a9a3-1431c6eb019a tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-78e03013-3283-47a1-a9a3-1431c6eb019a tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-78e03013-3283-47a1-a9a3-1431c6eb019a tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:13 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-78e03013-3283-47a1-a9a3-1431c6eb019a tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccad0e37147441cb68130a22197a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bb70c871154a14947ea3421553a229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:42:13 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-78e03013-3283-47a1-a9a3-1431c6eb019a tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aec86031-be71-4a8f-a8ad-cf04c506fdb4" status: 200 len: 1485 microversion: 2.1 time: 0.159996 Apr 12 10:42:13 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 140/419] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:42:13 2023] GET /compute/v2.1/servers/aec86031-be71-4a8f-a8ad-cf04c506fdb4 => generated 1485 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:42:15 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:15 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:15 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'services' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:42:15 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/os-volume_attachments/028bc65f-dc6d-4486-a99f-19a5ae874a93" status: 202 len: 0 microversion: 2.1 time: 0.174221 Apr 12 10:42:15 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 145/420] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 10:42:15 2023] DELETE /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/os-volume_attachments/028bc65f-dc6d-4486-a99f-19a5ae874a93 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:42:15 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5305cdf7-0c81-4fb7-afed-16da3d11f7bc tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:15 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5305cdf7-0c81-4fb7-afed-16da3d11f7bc tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5305cdf7-0c81-4fb7-afed-16da3d11f7bc tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5305cdf7-0c81-4fb7-afed-16da3d11f7bc tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5305cdf7-0c81-4fb7-afed-16da3d11f7bc tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5305cdf7-0c81-4fb7-afed-16da3d11f7bc tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5305cdf7-0c81-4fb7-afed-16da3d11f7bc tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5305cdf7-0c81-4fb7-afed-16da3d11f7bc tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5305cdf7-0c81-4fb7-afed-16da3d11f7bc tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051246 Apr 12 10:42:15 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 136/421] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:42:15 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:42:18 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-565d6a36-9c35-4e9f-8307-4956261e8a15 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:18 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-565d6a36-9c35-4e9f-8307-4956261e8a15 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-565d6a36-9c35-4e9f-8307-4956261e8a15 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-565d6a36-9c35-4e9f-8307-4956261e8a15 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-565d6a36-9c35-4e9f-8307-4956261e8a15 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-565d6a36-9c35-4e9f-8307-4956261e8a15 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-565d6a36-9c35-4e9f-8307-4956261e8a15 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-565d6a36-9c35-4e9f-8307-4956261e8a15 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:18 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-565d6a36-9c35-4e9f-8307-4956261e8a15 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c97c57a3e7142d088e1cf315f5d8d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16de154a6d344b18a939c6a1b1a679f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:42:18 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-565d6a36-9c35-4e9f-8307-4956261e8a15 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f834736-e836-49d3-b931-83ad82bef8f3" status: 200 len: 1497 microversion: 2.1 time: 0.217967 Apr 12 10:42:18 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 141/422] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:42:18 2023] GET /compute/v2.1/servers/7f834736-e836-49d3-b931-83ad82bef8f3 => generated 1497 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:42:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-694c17d8-0a94-42f1-b186-54fbeda90bfb tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:22 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-694c17d8-0a94-42f1-b186-54fbeda90bfb tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-694c17d8-0a94-42f1-b186-54fbeda90bfb tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-694c17d8-0a94-42f1-b186-54fbeda90bfb tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-694c17d8-0a94-42f1-b186-54fbeda90bfb tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-694c17d8-0a94-42f1-b186-54fbeda90bfb tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-694c17d8-0a94-42f1-b186-54fbeda90bfb tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-694c17d8-0a94-42f1-b186-54fbeda90bfb tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-694c17d8-0a94-42f1-b186-54fbeda90bfb tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] HTTP exception thrown: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. Apr 12 10:42:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-694c17d8-0a94-42f1-b186-54fbeda90bfb tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Request method failure captured: Apr 12 10:42:22 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8 HTTP/1.1 Apr 12 10:42:22 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:42:22 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:42:22 user devstack@n-api.service[61854]: Connection: close Apr 12 10:42:22 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:42:22 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:42:22 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:42:22 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:42:22 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:42:22 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNopRyj-EzUlDl-_rnQ2H3yOxkuX6WJujNLTeGG4axtuGlKH5Rh0DBeuHL2myp84PJtpbvgEE9tw89T0WgVNaB9iO26d7Uwg3otyKY6F9SBcNAmuRiyFCPcxM8nnE1wpRxJ391ixl3SFm0uBJqwL_0jBhAyvY6aBUv52NVZ2fKbp3gtI Apr 12 10:42:22 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:42:22 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:42:22 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:42:22 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:42:22 user devstack@n-api.service[61854]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 10:42:22 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:42:22 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:42:22 user devstack@n-api.service[61854]: X-Project-Id: f1ec9852adb94a5086dc3ef48871d5bc Apr 12 10:42:22 user devstack@n-api.service[61854]: X-Project-Name: tempest-TaggedBootDevicesTest-1574485217 Apr 12 10:42:22 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:42:22 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:42:22 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1ec9852adb94a5086dc3ef48871d5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1ec9852adb94a5086dc3ef48871d5bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1ec9852adb94a5086dc3ef48871d5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:42:22 user devstack@n-api.service[61854]: X-Tenant: tempest-TaggedBootDevicesTest-1574485217 Apr 12 10:42:22 user devstack@n-api.service[61854]: X-Tenant-Id: f1ec9852adb94a5086dc3ef48871d5bc Apr 12 10:42:22 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1574485217 Apr 12 10:42:22 user devstack@n-api.service[61854]: X-User: tempest-TaggedBootDevicesTest-1574485217-project-member Apr 12 10:42:22 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:42:22 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:42:22 user devstack@n-api.service[61854]: X-User-Id: 21034326c41f487181d19f60e0ccf219 Apr 12 10:42:22 user devstack@n-api.service[61854]: X-User-Name: tempest-TaggedBootDevicesTest-1574485217-project-member Apr 12 10:42:22 user devstack@n-api.service[61854]: method: > Apr 12 10:42:22 user devstack@n-api.service[61854]: exception: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. Apr 12 10:42:22 user devstack@n-api.service[61854]: action_args: {'id': '6b152adb-ca3d-45cf-a394-5ba5b36180a8'} Apr 12 10:42:22 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. Apr 12 10:42:22 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:42:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-694c17d8-0a94-42f1-b186-54fbeda90bfb tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Returning 404 to user: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:42:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-694c17d8-0a94-42f1-b186-54fbeda90bfb tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8" status: 404 len: 111 microversion: 2.32 time: 0.030822 Apr 12 10:42:22 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 146/423] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:42:22 2023] GET /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:42:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ef4ee00d-27db-4edd-8c4e-b821472cd7dd tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Calling method '.version_select at 0x7fabbf7b3be0>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-ef4ee00d-27db-4edd-8c4e-b821472cd7dd tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587791170" status: 204 len: 0 microversion: 2.32 time: 0.024272 Apr 12 10:42:22 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 137/424] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 10:42:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587791170 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 10:42:25 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-5eb403fc-ce23-4dc5-b8c7-47cc65b4e30c tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:25 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-5eb403fc-ce23-4dc5-b8c7-47cc65b4e30c tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5eb403fc-ce23-4dc5-b8c7-47cc65b4e30c tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5eb403fc-ce23-4dc5-b8c7-47cc65b4e30c tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5eb403fc-ce23-4dc5-b8c7-47cc65b4e30c tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5eb403fc-ce23-4dc5-b8c7-47cc65b4e30c tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5eb403fc-ce23-4dc5-b8c7-47cc65b4e30c tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5eb403fc-ce23-4dc5-b8c7-47cc65b4e30c tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-5eb403fc-ce23-4dc5-b8c7-47cc65b4e30c tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] HTTP exception thrown: Instance d04cb526-f77a-457c-90b1-3e5c202c0c30 could not be found. Apr 12 10:42:25 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-5eb403fc-ce23-4dc5-b8c7-47cc65b4e30c tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Request method failure captured: Apr 12 10:42:25 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30 HTTP/1.1 Apr 12 10:42:25 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:42:25 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:42:25 user devstack@n-api.service[61852]: Connection: close Apr 12 10:42:25 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:42:25 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:42:25 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:42:25 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:42:25 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:42:25 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNoluO1Bm_H-4gYbVuTcOPouBpPsKzP78vf4zWH6PD6P2phNHKvGPcw06MkSndMUAyin7ZkyZ9sQ2OChSJFu6ASJVQlfNmI9B3ZxwY4LrHmJNJi7xcLcqpM2BF0_wqfDECe5brSyDrqpcn6EZq_ZoyIlNHRIfrpRZZsQr_J9fA6Qxoqg Apr 12 10:42:25 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:42:25 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:42:25 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:42:25 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:42:25 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:42:25 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:42:25 user devstack@n-api.service[61852]: X-Project-Id: 0cdb8217b1544db384bebe1059848bb6 Apr 12 10:42:25 user devstack@n-api.service[61852]: X-Project-Name: tempest-VolumesAdminNegativeTest-375460860 Apr 12 10:42:25 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:42:25 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:42:25 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0cdb8217b1544db384bebe1059848bb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0cdb8217b1544db384bebe1059848bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0cdb8217b1544db384bebe1059848bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:42:25 user devstack@n-api.service[61852]: X-Tenant: tempest-VolumesAdminNegativeTest-375460860 Apr 12 10:42:25 user devstack@n-api.service[61852]: X-Tenant-Id: 0cdb8217b1544db384bebe1059848bb6 Apr 12 10:42:25 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-375460860 Apr 12 10:42:25 user devstack@n-api.service[61852]: X-User: tempest-VolumesAdminNegativeTest-375460860-project-member Apr 12 10:42:25 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:42:25 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:42:25 user devstack@n-api.service[61852]: X-User-Id: a0a2243c6c9f431da846cc54ec181fcc Apr 12 10:42:25 user devstack@n-api.service[61852]: X-User-Name: tempest-VolumesAdminNegativeTest-375460860-project-member Apr 12 10:42:25 user devstack@n-api.service[61852]: method: > Apr 12 10:42:25 user devstack@n-api.service[61852]: exception: Instance d04cb526-f77a-457c-90b1-3e5c202c0c30 could not be found. Apr 12 10:42:25 user devstack@n-api.service[61852]: action_args: {'id': 'd04cb526-f77a-457c-90b1-3e5c202c0c30'} Apr 12 10:42:25 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d04cb526-f77a-457c-90b1-3e5c202c0c30 could not be found. Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d04cb526-f77a-457c-90b1-3e5c202c0c30 could not be found. Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:42:25 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:42:26 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:42:26 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:42:26 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:42:26 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d04cb526-f77a-457c-90b1-3e5c202c0c30 could not be found. Apr 12 10:42:26 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:42:26 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-5eb403fc-ce23-4dc5-b8c7-47cc65b4e30c tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Returning 404 to user: Instance d04cb526-f77a-457c-90b1-3e5c202c0c30 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:42:26 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-5eb403fc-ce23-4dc5-b8c7-47cc65b4e30c tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30" status: 404 len: 111 microversion: 2.1 time: 0.041680 Apr 12 10:42:26 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 142/425] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:42:25 2023] GET /compute/v2.1/servers/d04cb526-f77a-457c-90b1-3e5c202c0c30 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:42:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-82d0aa44-ef15-40a9-b151-c6c89ee4bd7c tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Calling method '.version_select at 0x7fabbf789900>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-82d0aa44-ef15-40a9-b151-c6c89ee4bd7c tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1653078636" status: 202 len: 0 microversion: 2.1 time: 0.031330 Apr 12 10:42:26 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 147/426] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 10:42:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1653078636 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:42:27 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=10 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:42:27 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-9348b6a2-4655-4c76-a210-3883cd434eeb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae5450fe-d7d1-435d-bf24-e15cfd92e3fc"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:27 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-9348b6a2-4655-4c76-a210-3883cd434eeb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9348b6a2-4655-4c76-a210-3883cd434eeb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9348b6a2-4655-4c76-a210-3883cd434eeb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9348b6a2-4655-4c76-a210-3883cd434eeb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9348b6a2-4655-4c76-a210-3883cd434eeb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-49ac21fc-6c40-4b78-8f35-0ef02e14a4fe tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9348b6a2-4655-4c76-a210-3883cd434eeb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-49ac21fc-6c40-4b78-8f35-0ef02e14a4fe tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9348b6a2-4655-4c76-a210-3883cd434eeb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-49ac21fc-6c40-4b78-8f35-0ef02e14a4fe tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-49ac21fc-6c40-4b78-8f35-0ef02e14a4fe tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-49ac21fc-6c40-4b78-8f35-0ef02e14a4fe tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-49ac21fc-6c40-4b78-8f35-0ef02e14a4fe tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-49ac21fc-6c40-4b78-8f35-0ef02e14a4fe tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-49ac21fc-6c40-4b78-8f35-0ef02e14a4fe tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:27 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-49ac21fc-6c40-4b78-8f35-0ef02e14a4fe tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] HTTP exception thrown: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-49ac21fc-6c40-4b78-8f35-0ef02e14a4fe tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Request method failure captured: Apr 12 10:42:27 user devstack@n-api.service[61852]: request: DELETE /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8 HTTP/1.1 Apr 12 10:42:27 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:42:27 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:42:27 user devstack@n-api.service[61852]: Connection: close Apr 12 10:42:27 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:42:27 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:42:27 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:42:27 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:42:27 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:42:27 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNopRyj-EzUlDl-_rnQ2H3yOxkuX6WJujNLTeGG4axtuGlKH5Rh0DBeuHL2myp84PJtpbvgEE9tw89T0WgVNaB9iO26d7Uwg3otyKY6F9SBcNAmuRiyFCPcxM8nnE1wpRxJ391ixl3SFm0uBJqwL_0jBhAyvY6aBUv52NVZ2fKbp3gtI Apr 12 10:42:27 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:42:27 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:42:27 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:42:27 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:42:27 user devstack@n-api.service[61852]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 10:42:27 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:42:27 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:42:27 user devstack@n-api.service[61852]: X-Project-Id: f1ec9852adb94a5086dc3ef48871d5bc Apr 12 10:42:27 user devstack@n-api.service[61852]: X-Project-Name: tempest-TaggedBootDevicesTest-1574485217 Apr 12 10:42:27 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:42:27 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:42:27 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1ec9852adb94a5086dc3ef48871d5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1ec9852adb94a5086dc3ef48871d5bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1ec9852adb94a5086dc3ef48871d5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:42:27 user devstack@n-api.service[61852]: X-Tenant: tempest-TaggedBootDevicesTest-1574485217 Apr 12 10:42:27 user devstack@n-api.service[61852]: X-Tenant-Id: f1ec9852adb94a5086dc3ef48871d5bc Apr 12 10:42:27 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1574485217 Apr 12 10:42:27 user devstack@n-api.service[61852]: X-User: tempest-TaggedBootDevicesTest-1574485217-project-member Apr 12 10:42:27 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:42:27 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:42:27 user devstack@n-api.service[61852]: X-User-Id: 21034326c41f487181d19f60e0ccf219 Apr 12 10:42:27 user devstack@n-api.service[61852]: X-User-Name: tempest-TaggedBootDevicesTest-1574485217-project-member Apr 12 10:42:27 user devstack@n-api.service[61852]: method: > Apr 12 10:42:27 user devstack@n-api.service[61852]: exception: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. Apr 12 10:42:27 user devstack@n-api.service[61852]: action_args: {'id': '6b152adb-ca3d-45cf-a394-5ba5b36180a8'} Apr 12 10:42:27 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. Apr 12 10:42:27 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-49ac21fc-6c40-4b78-8f35-0ef02e14a4fe tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Returning 404 to user: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:42:27 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-49ac21fc-6c40-4b78-8f35-0ef02e14a4fe tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8" status: 404 len: 111 microversion: 2.32 time: 0.042491 Apr 12 10:42:27 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 143/427] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 10:42:27 2023] DELETE /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7a67c24b-ce42-429e-b908-7ad6022a9e16 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-7a67c24b-ce42-429e-b908-7ad6022a9e16 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7a67c24b-ce42-429e-b908-7ad6022a9e16 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7a67c24b-ce42-429e-b908-7ad6022a9e16 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7a67c24b-ce42-429e-b908-7ad6022a9e16 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7a67c24b-ce42-429e-b908-7ad6022a9e16 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7a67c24b-ce42-429e-b908-7ad6022a9e16 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7a67c24b-ce42-429e-b908-7ad6022a9e16 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:27 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-7a67c24b-ce42-429e-b908-7ad6022a9e16 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] HTTP exception thrown: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7a67c24b-ce42-429e-b908-7ad6022a9e16 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Request method failure captured: Apr 12 10:42:27 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8 HTTP/1.1 Apr 12 10:42:27 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:42:27 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:42:27 user devstack@n-api.service[61854]: Connection: close Apr 12 10:42:27 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:42:27 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:42:27 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:42:27 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:42:27 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:42:27 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNopRyj-EzUlDl-_rnQ2H3yOxkuX6WJujNLTeGG4axtuGlKH5Rh0DBeuHL2myp84PJtpbvgEE9tw89T0WgVNaB9iO26d7Uwg3otyKY6F9SBcNAmuRiyFCPcxM8nnE1wpRxJ391ixl3SFm0uBJqwL_0jBhAyvY6aBUv52NVZ2fKbp3gtI Apr 12 10:42:27 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:42:27 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:42:27 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:42:27 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:42:27 user devstack@n-api.service[61854]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 10:42:27 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:42:27 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:42:27 user devstack@n-api.service[61854]: X-Project-Id: f1ec9852adb94a5086dc3ef48871d5bc Apr 12 10:42:27 user devstack@n-api.service[61854]: X-Project-Name: tempest-TaggedBootDevicesTest-1574485217 Apr 12 10:42:27 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:42:27 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:42:27 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1ec9852adb94a5086dc3ef48871d5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1ec9852adb94a5086dc3ef48871d5bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1ec9852adb94a5086dc3ef48871d5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:42:27 user devstack@n-api.service[61854]: X-Tenant: tempest-TaggedBootDevicesTest-1574485217 Apr 12 10:42:27 user devstack@n-api.service[61854]: X-Tenant-Id: f1ec9852adb94a5086dc3ef48871d5bc Apr 12 10:42:27 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1574485217 Apr 12 10:42:27 user devstack@n-api.service[61854]: X-User: tempest-TaggedBootDevicesTest-1574485217-project-member Apr 12 10:42:27 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:42:27 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:42:27 user devstack@n-api.service[61854]: X-User-Id: 21034326c41f487181d19f60e0ccf219 Apr 12 10:42:27 user devstack@n-api.service[61854]: X-User-Name: tempest-TaggedBootDevicesTest-1574485217-project-member Apr 12 10:42:27 user devstack@n-api.service[61854]: method: > Apr 12 10:42:27 user devstack@n-api.service[61854]: exception: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. Apr 12 10:42:27 user devstack@n-api.service[61854]: action_args: {'id': '6b152adb-ca3d-45cf-a394-5ba5b36180a8'} Apr 12 10:42:27 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. Apr 12 10:42:27 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7a67c24b-ce42-429e-b908-7ad6022a9e16 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Returning 404 to user: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:42:27 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-7a67c24b-ce42-429e-b908-7ad6022a9e16 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8" status: 404 len: 111 microversion: 2.32 time: 0.030692 Apr 12 10:42:27 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 148/428] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:42:27 2023] GET /compute/v2.1/servers/6b152adb-ca3d-45cf-a394-5ba5b36180a8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:42:27 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-9348b6a2-4655-4c76-a210-3883cd434eeb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.338383 Apr 12 10:42:27 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 138/429] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 10:42:27 2023] POST /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa/os-volume_attachments => generated 188 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:27 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61852) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 10:42:27 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa/action" status: 202 len: 0 microversion: 2.20 time: 0.111452 Apr 12 10:42:27 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 144/430] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 10:42:27 2023] POST /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b52dfa50-abd0-4e05-9e45-7f51e1d2d322 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-b52dfa50-abd0-4e05-9e45-7f51e1d2d322 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b52dfa50-abd0-4e05-9e45-7f51e1d2d322 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b52dfa50-abd0-4e05-9e45-7f51e1d2d322 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b52dfa50-abd0-4e05-9e45-7f51e1d2d322 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b52dfa50-abd0-4e05-9e45-7f51e1d2d322 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b52dfa50-abd0-4e05-9e45-7f51e1d2d322 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b52dfa50-abd0-4e05-9e45-7f51e1d2d322 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-b52dfa50-abd0-4e05-9e45-7f51e1d2d322 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-b52dfa50-abd0-4e05-9e45-7f51e1d2d322 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:42:27 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-b52dfa50-abd0-4e05-9e45-7f51e1d2d322 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:42:27 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b52dfa50-abd0-4e05-9e45-7f51e1d2d322 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa" status: 200 len: 1738 microversion: 2.20 time: 0.217658 Apr 12 10:42:27 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 149/431] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:42:27 2023] GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:42:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a3efca8c-2c8f-4c34-bc83-e7f1afe82c25 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:30 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a3efca8c-2c8f-4c34-bc83-e7f1afe82c25 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a3efca8c-2c8f-4c34-bc83-e7f1afe82c25 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a3efca8c-2c8f-4c34-bc83-e7f1afe82c25 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a3efca8c-2c8f-4c34-bc83-e7f1afe82c25 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a3efca8c-2c8f-4c34-bc83-e7f1afe82c25 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a3efca8c-2c8f-4c34-bc83-e7f1afe82c25 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a3efca8c-2c8f-4c34-bc83-e7f1afe82c25 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:30 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-a3efca8c-2c8f-4c34-bc83-e7f1afe82c25 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574af27cae41457c9be3d5d50d347b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef7aa45de34b01a97b6bc5e0acece5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:42:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a3efca8c-2c8f-4c34-bc83-e7f1afe82c25 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e" status: 200 len: 1432 microversion: 2.1 time: 0.160979 Apr 12 10:42:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 139/432] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:42:30 2023] GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e => generated 1432 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:42:35 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-4be91e32-6dcf-4968-8ff0-83d9266b49eb req-b036f041-f864-4388-b927-08b8091008c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bfafa79-ce40-42f1-9992-10e50734f7fa", "tag": "4de5a799-c343-4e41-88ef-ebaaa3adb14c"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:35 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:42:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-4be91e32-6dcf-4968-8ff0-83d9266b49eb req-b036f041-f864-4388-b927-08b8091008c9 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-4be91e32-6dcf-4968-8ff0-83d9266b49eb req-b036f041-f864-4388-b927-08b8091008c9 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-4be91e32-6dcf-4968-8ff0-83d9266b49eb req-b036f041-f864-4388-b927-08b8091008c9 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:35 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:42:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-4be91e32-6dcf-4968-8ff0-83d9266b49eb req-b036f041-f864-4388-b927-08b8091008c9 service nova] Creating event network-changed:4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance 0bfafa79-ce40-42f1-9992-10e50734f7fa on user Apr 12 10:42:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-4be91e32-6dcf-4968-8ff0-83d9266b49eb req-b036f041-f864-4388-b927-08b8091008c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043332 Apr 12 10:42:35 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 145/433] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:42:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:42:36 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-1ad27ff9-860f-4f7e-b458-85427a0afcd1 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:36 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-1ad27ff9-860f-4f7e-b458-85427a0afcd1 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:36 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:42:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1ad27ff9-860f-4f7e-b458-85427a0afcd1 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1ad27ff9-860f-4f7e-b458-85427a0afcd1 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1ad27ff9-860f-4f7e-b458-85427a0afcd1 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1ad27ff9-860f-4f7e-b458-85427a0afcd1 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1ad27ff9-860f-4f7e-b458-85427a0afcd1 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1ad27ff9-860f-4f7e-b458-85427a0afcd1 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:36 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:42:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-1ad27ff9-860f-4f7e-b458-85427a0afcd1 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.146446 Apr 12 10:42:36 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 150/434] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:42:36 2023] GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 10:42:38 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-18a4fbc8-ba68-4ea0-a271-8bb362c3261c tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '.version_select at 0x7fabbf8d08b0>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-18a4fbc8-ba68-4ea0-a271-8bb362c3261c tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/f4fcf2fb-8011-4377-96b3-cd19c43f5545" status: 204 len: 0 microversion: 2.1 time: 0.239783 Apr 12 10:42:39 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 140/435] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:42:38 2023] DELETE /compute/v2.1/images/f4fcf2fb-8011-4377-96b3-cd19c43f5545 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:42:39 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:39 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:39 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:42:39 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5" status: 204 len: 0 microversion: 2.1 time: 0.140397 Apr 12 10:42:39 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 146/436] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:42:39 2023] DELETE /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:42:39 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-100474a3-e537-44a1-a25e-3a4817cd790b tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:39 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-100474a3-e537-44a1-a25e-3a4817cd790b tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-100474a3-e537-44a1-a25e-3a4817cd790b tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-100474a3-e537-44a1-a25e-3a4817cd790b tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-100474a3-e537-44a1-a25e-3a4817cd790b tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-100474a3-e537-44a1-a25e-3a4817cd790b tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-100474a3-e537-44a1-a25e-3a4817cd790b tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-100474a3-e537-44a1-a25e-3a4817cd790b tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-48de4e0d-fa5d-4dc9-9654-7123c2d6ff86 req-553e7653-9e81-4a32-96dc-7d9533736462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47d368e-3870-49d0-8522-a94991ec4ba5", "name": "network-vif-unplugged", "status": "completed", "tag": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:39 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:42:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-48de4e0d-fa5d-4dc9-9654-7123c2d6ff86 req-553e7653-9e81-4a32-96dc-7d9533736462 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-48de4e0d-fa5d-4dc9-9654-7123c2d6ff86 req-553e7653-9e81-4a32-96dc-7d9533736462 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-48de4e0d-fa5d-4dc9-9654-7123c2d6ff86 req-553e7653-9e81-4a32-96dc-7d9533736462 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-48de4e0d-fa5d-4dc9-9654-7123c2d6ff86 req-553e7653-9e81-4a32-96dc-7d9533736462 service nova] Creating event network-vif-unplugged:7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance f47d368e-3870-49d0-8522-a94991ec4ba5 on user Apr 12 10:42:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-48de4e0d-fa5d-4dc9-9654-7123c2d6ff86 req-553e7653-9e81-4a32-96dc-7d9533736462 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042600 Apr 12 10:42:39 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 141/437] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:42:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:42:39 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-100474a3-e537-44a1-a25e-3a4817cd790b tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c757f04065b9488ba75739e59d7be377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce2a3bde13e464f8df0a41f30c240ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:42:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-100474a3-e537-44a1-a25e-3a4817cd790b tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5" status: 200 len: 1677 microversion: 2.1 time: 0.379463 Apr 12 10:42:39 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 151/438] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:42:39 2023] GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5 => generated 1677 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:42:41 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-8be707e7-a8ef-43e1-a502-6edd1a8e5baf req-0656bb0e-bf55-4550-b4c9-d8240c0ee6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47d368e-3870-49d0-8522-a94991ec4ba5", "name": "network-vif-plugged", "status": "completed", "tag": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c"}, {"server_uuid": "f47d368e-3870-49d0-8522-a94991ec4ba5", "name": "network-vif-deleted", "tag": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-8be707e7-a8ef-43e1-a502-6edd1a8e5baf req-0656bb0e-bf55-4550-b4c9-d8240c0ee6b1 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-8be707e7-a8ef-43e1-a502-6edd1a8e5baf req-0656bb0e-bf55-4550-b4c9-d8240c0ee6b1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-8be707e7-a8ef-43e1-a502-6edd1a8e5baf req-0656bb0e-bf55-4550-b4c9-d8240c0ee6b1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:41 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-8be707e7-a8ef-43e1-a502-6edd1a8e5baf req-0656bb0e-bf55-4550-b4c9-d8240c0ee6b1 service nova] Creating event network-vif-plugged:7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance f47d368e-3870-49d0-8522-a94991ec4ba5 on user Apr 12 10:42:41 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-8be707e7-a8ef-43e1-a502-6edd1a8e5baf req-0656bb0e-bf55-4550-b4c9-d8240c0ee6b1 service nova] Creating event network-vif-deleted:7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance f47d368e-3870-49d0-8522-a94991ec4ba5 on user Apr 12 10:42:41 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-8be707e7-a8ef-43e1-a502-6edd1a8e5baf req-0656bb0e-bf55-4550-b4c9-d8240c0ee6b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031460 Apr 12 10:42:41 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 147/439] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:42:41 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:42:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-61c3b6b7-ff8c-4af8-9350-a52db953f95a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Action: 'create', calling method: .version_select at 0x7fabbf7b35b0>, body: {"keypair": {"name": "tempest-keypair-427188730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLI/6/yskGDC/kneATQrlM5ySdnkfz5IHk2qD3yn85kz4nSdofboB+BktBB+DBbMhyOy23QhYD/YquSqOPbUt1xakLZAcNyRXoXQD1kQSLURiFJdfuh9KazJ/4uYci+IOg=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:43 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-61c3b6b7-ff8c-4af8-9350-a52db953f95a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting quotas for project c3cecbfbfd5f42dbb663367f6fbdf3b0. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:42:43 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-61c3b6b7-ff8c-4af8-9350-a52db953f95a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting quotas for user 7ec47d3cdacb45e5a39509e76b546e34 and project c3cecbfbfd5f42dbb663367f6fbdf3b0. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:42:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-61c3b6b7-ff8c-4af8-9350-a52db953f95a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.250260 Apr 12 10:42:43 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 142/440] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 10:42:43 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:42:44 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-61727e5a-7373-464b-ac94-ca182108c0de req-672f71b0-b788-408c-b05f-198bcd0876f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bfafa79-ce40-42f1-9992-10e50734f7fa", "name": "network-vif-plugged", "status": "completed", "tag": "4de5a799-c343-4e41-88ef-ebaaa3adb14c"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-61727e5a-7373-464b-ac94-ca182108c0de req-672f71b0-b788-408c-b05f-198bcd0876f7 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-61727e5a-7373-464b-ac94-ca182108c0de req-672f71b0-b788-408c-b05f-198bcd0876f7 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-61727e5a-7373-464b-ac94-ca182108c0de req-672f71b0-b788-408c-b05f-198bcd0876f7 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-61727e5a-7373-464b-ac94-ca182108c0de req-672f71b0-b788-408c-b05f-198bcd0876f7 service nova] Creating event network-vif-plugged:4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance 0bfafa79-ce40-42f1-9992-10e50734f7fa on user Apr 12 10:42:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-61727e5a-7373-464b-ac94-ca182108c0de req-672f71b0-b788-408c-b05f-198bcd0876f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033106 Apr 12 10:42:44 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 152/441] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:42:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:42:46 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-454382670", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0"}], "security_groups": [{"name": "tempest-securitygroup--1283278856"}], "key_name": "tempest-keypair-427188730", "user_data": "}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:46 user devstack@n-api.service[61852]: DEBUG nova.network.neutron [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] validate_networks() for [('ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0', None, None, None, None, None)] {{(pid=61852) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:42:46 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-ea83a137-c3e3-40bd-931e-98e69f993b1d req-05ecf56f-420b-416f-bc09-2ef88eaaf962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bfafa79-ce40-42f1-9992-10e50734f7fa", "name": "network-vif-plugged", "status": "completed", "tag": "4de5a799-c343-4e41-88ef-ebaaa3adb14c"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ea83a137-c3e3-40bd-931e-98e69f993b1d req-05ecf56f-420b-416f-bc09-2ef88eaaf962 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ea83a137-c3e3-40bd-931e-98e69f993b1d req-05ecf56f-420b-416f-bc09-2ef88eaaf962 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:46 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ea83a137-c3e3-40bd-931e-98e69f993b1d req-05ecf56f-420b-416f-bc09-2ef88eaaf962 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:46 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-ea83a137-c3e3-40bd-931e-98e69f993b1d req-05ecf56f-420b-416f-bc09-2ef88eaaf962 service nova] Creating event network-vif-plugged:4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance 0bfafa79-ce40-42f1-9992-10e50734f7fa on user Apr 12 10:42:46 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-ea83a137-c3e3-40bd-931e-98e69f993b1d req-05ecf56f-420b-416f-bc09-2ef88eaaf962 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027656 Apr 12 10:42:46 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 143/442] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:42:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:42:46 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flavor limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:42:46 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Image limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:42:46 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flavor pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:42:46 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Image pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:42:46 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:42:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:46 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting quotas for project c3cecbfbfd5f42dbb663367f6fbdf3b0. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:42:46 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting quotas for user 7ec47d3cdacb45e5a39509e76b546e34 and project c3cecbfbfd5f42dbb663367f6fbdf3b0. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:42:46 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Going to run 1 instances... {{(pid=61852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:42:46 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:42:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.800503 Apr 12 10:42:46 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 148/443] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:42:46 2023] POST /compute/v2.1/servers => generated 400 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:42:46 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-bd87358c-6d11-423f-bf1c-2ae99264d6ee tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:46 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-bd87358c-6d11-423f-bf1c-2ae99264d6ee tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:47 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-bd87358c-6d11-423f-bf1c-2ae99264d6ee tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec47d3cdacb45e5a39509e76b546e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cecbfbfd5f42dbb663367f6fbdf3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:42:47 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-bd87358c-6d11-423f-bf1c-2ae99264d6ee tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683" status: 200 len: 1234 microversion: 2.1 time: 0.070494 Apr 12 10:42:47 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 153/444] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:42:46 2023] GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683 => generated 1234 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:42:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1871933050", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:50 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] validate_networks() for [('98c9dc65-829b-425d-8645-c7e8998720cc', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Getting quotas for project 2b39cd8e55b54a86a7784f2934273e20. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Getting quotas for user abdf772f2c7341c29159b6f1f2ce7ccb and project 2b39cd8e55b54a86a7784f2934273e20. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:42:51 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.715691 Apr 12 10:42:51 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 144/445] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:42:50 2023] POST /compute/v2.1/servers => generated 381 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:42:51 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-7b4a1391-9194-44aa-8c50-29735d7187f3 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:51 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-7b4a1391-9194-44aa-8c50-29735d7187f3 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:51 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-7b4a1391-9194-44aa-8c50-29735d7187f3 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:42:51 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-7b4a1391-9194-44aa-8c50-29735d7187f3 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48" status: 200 len: 1216 microversion: 2.1 time: 0.148490 Apr 12 10:42:51 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 149/446] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:42:51 2023] GET /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48 => generated 1216 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:42:51 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-755364809", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:51 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] validate_networks() for [('98c9dc65-829b-425d-8645-c7e8998720cc', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-287984fd-37a9-4baf-acd0-33328bfa1f59 req-307541ef-1f6a-453f-8e33-8dfb6bbb7a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b79f4d7-f34e-4971-8a6f-171c2d71d683", "tag": "ac9512bb-5122-4a70-b970-f82605ed0606"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-287984fd-37a9-4baf-acd0-33328bfa1f59 req-307541ef-1f6a-453f-8e33-8dfb6bbb7a28 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-287984fd-37a9-4baf-acd0-33328bfa1f59 req-307541ef-1f6a-453f-8e33-8dfb6bbb7a28 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:51 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-287984fd-37a9-4baf-acd0-33328bfa1f59 req-307541ef-1f6a-453f-8e33-8dfb6bbb7a28 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:51 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-287984fd-37a9-4baf-acd0-33328bfa1f59 req-307541ef-1f6a-453f-8e33-8dfb6bbb7a28 service nova] Creating event network-changed:ac9512bb-5122-4a70-b970-f82605ed0606 for instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 on user Apr 12 10:42:51 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-287984fd-37a9-4baf-acd0-33328bfa1f59 req-307541ef-1f6a-453f-8e33-8dfb6bbb7a28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038742 Apr 12 10:42:51 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 145/447] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:42:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:42:51 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:42:51 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:42:51 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:42:51 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:42:51 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:42:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:51 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:51 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Getting quotas for project 2b39cd8e55b54a86a7784f2934273e20. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:42:51 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Getting quotas for user abdf772f2c7341c29159b6f1f2ce7ccb and project 2b39cd8e55b54a86a7784f2934273e20. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:42:51 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:42:51 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:42:52 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.556123 Apr 12 10:42:52 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 154/448] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:42:51 2023] POST /compute/v2.1/servers => generated 381 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:42:52 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-4ffc343f-f226-41d3-818a-87dfb1d9b0b4 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:52 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-4ffc343f-f226-41d3-818a-87dfb1d9b0b4 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:52 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-4ffc343f-f226-41d3-818a-87dfb1d9b0b4 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:42:52 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-4ffc343f-f226-41d3-818a-87dfb1d9b0b4 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97bafe22-36bf-4939-baf8-9602551bad52" status: 200 len: 1215 microversion: 2.1 time: 0.091850 Apr 12 10:42:52 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 150/449] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:42:52 2023] GET /compute/v2.1/servers/97bafe22-36bf-4939-baf8-9602551bad52 => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:42:54 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-716772f0-bd3b-443c-bb3a-79a817907845 req-c23b97bb-e1e4-46e8-aba9-8ccd80275214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b79f4d7-f34e-4971-8a6f-171c2d71d683", "name": "network-vif-plugged", "status": "completed", "tag": "ac9512bb-5122-4a70-b970-f82605ed0606"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-716772f0-bd3b-443c-bb3a-79a817907845 req-c23b97bb-e1e4-46e8-aba9-8ccd80275214 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-716772f0-bd3b-443c-bb3a-79a817907845 req-c23b97bb-e1e4-46e8-aba9-8ccd80275214 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-716772f0-bd3b-443c-bb3a-79a817907845 req-c23b97bb-e1e4-46e8-aba9-8ccd80275214 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:54 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-716772f0-bd3b-443c-bb3a-79a817907845 req-c23b97bb-e1e4-46e8-aba9-8ccd80275214 service nova] Creating event network-vif-plugged:ac9512bb-5122-4a70-b970-f82605ed0606 for instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 on user Apr 12 10:42:54 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-716772f0-bd3b-443c-bb3a-79a817907845 req-c23b97bb-e1e4-46e8-aba9-8ccd80275214 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049414 Apr 12 10:42:54 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 146/450] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:42:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:42:54 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-24f1b11d-4220-416c-a301-57457c35c994 req-481f4128-667b-44a3-8c5d-f31d09c77a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be3f67e5-420d-42a2-b68a-7cadff22fa48", "tag": "943dbed4-3180-4221-b27c-710c0118b7cf"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-24f1b11d-4220-416c-a301-57457c35c994 req-481f4128-667b-44a3-8c5d-f31d09c77a96 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-24f1b11d-4220-416c-a301-57457c35c994 req-481f4128-667b-44a3-8c5d-f31d09c77a96 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-24f1b11d-4220-416c-a301-57457c35c994 req-481f4128-667b-44a3-8c5d-f31d09c77a96 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-24f1b11d-4220-416c-a301-57457c35c994 req-481f4128-667b-44a3-8c5d-f31d09c77a96 service nova] Creating event network-changed:943dbed4-3180-4221-b27c-710c0118b7cf for instance be3f67e5-420d-42a2-b68a-7cadff22fa48 on user Apr 12 10:42:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-24f1b11d-4220-416c-a301-57457c35c994 req-481f4128-667b-44a3-8c5d-f31d09c77a96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050561 Apr 12 10:42:54 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 155/451] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:42:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:42:55 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-f696347e-9392-408e-9ebb-36df19860bba tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:42:55 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-f696347e-9392-408e-9ebb-36df19860bba tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:42:55 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f696347e-9392-408e-9ebb-36df19860bba tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:55 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f696347e-9392-408e-9ebb-36df19860bba tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:55 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f696347e-9392-408e-9ebb-36df19860bba tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:55 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f696347e-9392-408e-9ebb-36df19860bba tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:55 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f696347e-9392-408e-9ebb-36df19860bba tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:55 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f696347e-9392-408e-9ebb-36df19860bba tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:55 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-f696347e-9392-408e-9ebb-36df19860bba tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:42:55 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-f696347e-9392-408e-9ebb-36df19860bba tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:42:55 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-f696347e-9392-408e-9ebb-36df19860bba tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:42:55 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-f696347e-9392-408e-9ebb-36df19860bba tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" status: 200 len: 1767 microversion: 2.87 time: 0.244222 Apr 12 10:42:55 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 151/452] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:42:55 2023] GET /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 => generated 1767 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:42:56 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b79f4d7-f34e-4971-8a6f-171c2d71d683", "name": "network-vif-plugged", "status": "completed", "tag": "ac9512bb-5122-4a70-b970-f82605ed0606"}, {"name": "network-changed", "server_uuid": "97bafe22-36bf-4939-baf8-9602551bad52", "tag": "580ed46e-ff10-494f-b864-42eda726a7ff"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] Creating event network-vif-plugged:ac9512bb-5122-4a70-b970-f82605ed0606 for instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 on user Apr 12 10:42:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] Creating event network-changed:580ed46e-ff10-494f-b864-42eda726a7ff for instance 97bafe22-36bf-4939-baf8-9602551bad52 on user Apr 12 10:42:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.044610 Apr 12 10:42:56 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 147/453] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:42:56 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:42:57 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-c7f77878-ed36-4191-b667-0d31dc4c0835 req-ae75263d-33e8-4e9a-8bbb-716ccb42155e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3f67e5-420d-42a2-b68a-7cadff22fa48", "name": "network-vif-plugged", "status": "completed", "tag": "943dbed4-3180-4221-b27c-710c0118b7cf"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c7f77878-ed36-4191-b667-0d31dc4c0835 req-ae75263d-33e8-4e9a-8bbb-716ccb42155e service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c7f77878-ed36-4191-b667-0d31dc4c0835 req-ae75263d-33e8-4e9a-8bbb-716ccb42155e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-c7f77878-ed36-4191-b667-0d31dc4c0835 req-ae75263d-33e8-4e9a-8bbb-716ccb42155e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-c7f77878-ed36-4191-b667-0d31dc4c0835 req-ae75263d-33e8-4e9a-8bbb-716ccb42155e service nova] Creating event network-vif-plugged:943dbed4-3180-4221-b27c-710c0118b7cf for instance be3f67e5-420d-42a2-b68a-7cadff22fa48 on user Apr 12 10:42:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-c7f77878-ed36-4191-b667-0d31dc4c0835 req-ae75263d-33e8-4e9a-8bbb-716ccb42155e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038331 Apr 12 10:42:57 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 156/454] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:42:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:42:58 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-8cb12b4d-a622-436b-88a9-be1f40a15d8a req-96141d36-79c6-4785-ae85-39eceaa14dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97bafe22-36bf-4939-baf8-9602551bad52", "name": "network-vif-plugged", "status": "completed", "tag": "580ed46e-ff10-494f-b864-42eda726a7ff"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:42:58 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:42:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-8cb12b4d-a622-436b-88a9-be1f40a15d8a req-96141d36-79c6-4785-ae85-39eceaa14dcc service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:42:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-8cb12b4d-a622-436b-88a9-be1f40a15d8a req-96141d36-79c6-4785-ae85-39eceaa14dcc service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:42:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-8cb12b4d-a622-436b-88a9-be1f40a15d8a req-96141d36-79c6-4785-ae85-39eceaa14dcc service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:42:58 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-8cb12b4d-a622-436b-88a9-be1f40a15d8a req-96141d36-79c6-4785-ae85-39eceaa14dcc service nova] Creating event network-vif-plugged:580ed46e-ff10-494f-b864-42eda726a7ff for instance 97bafe22-36bf-4939-baf8-9602551bad52 on user Apr 12 10:42:58 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-8cb12b4d-a622-436b-88a9-be1f40a15d8a req-96141d36-79c6-4785-ae85-39eceaa14dcc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033519 Apr 12 10:42:58 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 152/455] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:42:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:43:00 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-7ce4a7c4-8a00-4270-a598-3872249d7de3 req-9dca20c2-eb1f-43af-8492-2aecc1494eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3f67e5-420d-42a2-b68a-7cadff22fa48", "name": "network-vif-plugged", "status": "completed", "tag": "943dbed4-3180-4221-b27c-710c0118b7cf"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:43:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-7ce4a7c4-8a00-4270-a598-3872249d7de3 req-9dca20c2-eb1f-43af-8492-2aecc1494eb6 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-7ce4a7c4-8a00-4270-a598-3872249d7de3 req-9dca20c2-eb1f-43af-8492-2aecc1494eb6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:00 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-7ce4a7c4-8a00-4270-a598-3872249d7de3 req-9dca20c2-eb1f-43af-8492-2aecc1494eb6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:00 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:00 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-7ce4a7c4-8a00-4270-a598-3872249d7de3 req-9dca20c2-eb1f-43af-8492-2aecc1494eb6 service nova] Creating event network-vif-plugged:943dbed4-3180-4221-b27c-710c0118b7cf for instance be3f67e5-420d-42a2-b68a-7cadff22fa48 on user Apr 12 10:43:00 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-7ce4a7c4-8a00-4270-a598-3872249d7de3 req-9dca20c2-eb1f-43af-8492-2aecc1494eb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038425 Apr 12 10:43:00 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 148/456] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:43:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:43:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-4b63c288-285e-4281-9580-aecf3e748fcf req-3985ae9b-ca49-41b1-a8d0-63a6ec62ffe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97bafe22-36bf-4939-baf8-9602551bad52", "name": "network-vif-plugged", "status": "completed", "tag": "580ed46e-ff10-494f-b864-42eda726a7ff"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:43:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-4b63c288-285e-4281-9580-aecf3e748fcf req-3985ae9b-ca49-41b1-a8d0-63a6ec62ffe1 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-4b63c288-285e-4281-9580-aecf3e748fcf req-3985ae9b-ca49-41b1-a8d0-63a6ec62ffe1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-4b63c288-285e-4281-9580-aecf3e748fcf req-3985ae9b-ca49-41b1-a8d0-63a6ec62ffe1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-4b63c288-285e-4281-9580-aecf3e748fcf req-3985ae9b-ca49-41b1-a8d0-63a6ec62ffe1 service nova] Creating event network-vif-plugged:580ed46e-ff10-494f-b864-42eda726a7ff for instance 97bafe22-36bf-4939-baf8-9602551bad52 on user Apr 12 10:43:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-4b63c288-285e-4281-9580-aecf3e748fcf req-3985ae9b-ca49-41b1-a8d0-63a6ec62ffe1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057945 Apr 12 10:43:00 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 157/457] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:43:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:43:05 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=10 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:05 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-98861d70-c6c3-48f2-a81c-c409e21b7ebe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:43:05 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-98861d70-c6c3-48f2-a81c-c409e21b7ebe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-98861d70-c6c3-48f2-a81c-c409e21b7ebe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-98861d70-c6c3-48f2-a81c-c409e21b7ebe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-98861d70-c6c3-48f2-a81c-c409e21b7ebe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-98861d70-c6c3-48f2-a81c-c409e21b7ebe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-98861d70-c6c3-48f2-a81c-c409e21b7ebe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-98861d70-c6c3-48f2-a81c-c409e21b7ebe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:05 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-98861d70-c6c3-48f2-a81c-c409e21b7ebe tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045082 Apr 12 10:43:05 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 153/458] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:43:05 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 10:43:05 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:05 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=10 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:05 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-337d4d1b-a822-4ff2-af9a-a056202ddbf4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:43:05 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-337d4d1b-a822-4ff2-af9a-a056202ddbf4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-337d4d1b-a822-4ff2-af9a-a056202ddbf4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-337d4d1b-a822-4ff2-af9a-a056202ddbf4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-337d4d1b-a822-4ff2-af9a-a056202ddbf4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-337d4d1b-a822-4ff2-af9a-a056202ddbf4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-337d4d1b-a822-4ff2-af9a-a056202ddbf4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:05 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-337d4d1b-a822-4ff2-af9a-a056202ddbf4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:05 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-337d4d1b-a822-4ff2-af9a-a056202ddbf4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:43:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-337d4d1b-a822-4ff2-af9a-a056202ddbf4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1677 microversion: 2.1 time: 0.185125 Apr 12 10:43:05 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 149/459] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:43:05 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:43:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0d3be540-5557-4737-afa1-4459042425ab tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:43:05 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-0d3be540-5557-4737-afa1-4459042425ab tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:05 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:05 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=8 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0d3be540-5557-4737-afa1-4459042425ab tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0d3be540-5557-4737-afa1-4459042425ab tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0d3be540-5557-4737-afa1-4459042425ab tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0d3be540-5557-4737-afa1-4459042425ab tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0d3be540-5557-4737-afa1-4459042425ab tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0d3be540-5557-4737-afa1-4459042425ab tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:06 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-0d3be540-5557-4737-afa1-4459042425ab tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:43:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-0d3be540-5557-4737-afa1-4459042425ab tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1677 microversion: 2.1 time: 0.164499 Apr 12 10:43:06 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 158/460] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:43:05 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:43:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-cb3590e7-1c24-4dcd-9766-3f162e689354 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:43:06 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-cb3590e7-1c24-4dcd-9766-3f162e689354 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:06 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-cb3590e7-1c24-4dcd-9766-3f162e689354 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-cb3590e7-1c24-4dcd-9766-3f162e689354 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-cb3590e7-1c24-4dcd-9766-3f162e689354 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-cb3590e7-1c24-4dcd-9766-3f162e689354 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-cb3590e7-1c24-4dcd-9766-3f162e689354 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-cb3590e7-1c24-4dcd-9766-3f162e689354 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:06 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-cb3590e7-1c24-4dcd-9766-3f162e689354 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:43:06 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-cb3590e7-1c24-4dcd-9766-3f162e689354 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1677 microversion: 2.1 time: 0.163896 Apr 12 10:43:06 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 154/461] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:43:06 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:43:09 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a5cd9b4b-b729-47b9-bcc9-b5d21f9d276b tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-368348323", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "destination_type": "local"}, {"source_type": "volume", "uuid": "a58c219d-6165-465b-a44c-dd79da178951", "destination_type": "invalid"}], "networks": [{"uuid": "092e35b9-633d-403b-a777-df3e8c018327"}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:43:09 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a5cd9b4b-b729-47b9-bcc9-b5d21f9d276b tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Request method failure captured: Apr 12 10:43:09 user devstack@n-api.service[61853]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 12 10:43:09 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:43:09 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:43:09 user devstack@n-api.service[61853]: Connection: close Apr 12 10:43:09 user devstack@n-api.service[61853]: Content-Length: 493 Apr 12 10:43:09 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:43:09 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:43:09 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:43:09 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:43:09 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolyPj4uP3fUaGvJghQbYB0eJurMk0aTXOP8m_SRC4HCE3RKd0kG4NblpxL-3HoVpVY4fHbUBjkQR9sFtLPZCwY79AY01f-FnXJli2U-y_sg0L5mYp62dEOpZN86j2hPkA0DEz8im88zu7QIITcqH4-51-4fU1cE5F0swgyw4tBPWWI Apr 12 10:43:09 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:43:09 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:43:09 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:43:09 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:43:09 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:43:09 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:43:09 user devstack@n-api.service[61853]: X-Project-Id: 024682bfda5548b8b9b404c85dd55b34 Apr 12 10:43:09 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServersNegativeTestJSON-563292074 Apr 12 10:43:09 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:43:09 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:43:09 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/024682bfda5548b8b9b404c85dd55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/024682bfda5548b8b9b404c85dd55b34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/024682bfda5548b8b9b404c85dd55b34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:43:09 user devstack@n-api.service[61853]: X-Tenant: tempest-ServersNegativeTestJSON-563292074 Apr 12 10:43:09 user devstack@n-api.service[61853]: X-Tenant-Id: 024682bfda5548b8b9b404c85dd55b34 Apr 12 10:43:09 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServersNegativeTestJSON-563292074 Apr 12 10:43:09 user devstack@n-api.service[61853]: X-User: tempest-ServersNegativeTestJSON-563292074-project-member Apr 12 10:43:09 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:43:09 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:43:09 user devstack@n-api.service[61853]: X-User-Id: 33d19bfc4894401cb664521438338b9a Apr 12 10:43:09 user devstack@n-api.service[61853]: X-User-Name: tempest-ServersNegativeTestJSON-563292074-project-member Apr 12 10:43:09 user devstack@n-api.service[61853]: Apr 12 10:43:09 user devstack@n-api.service[61853]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-368348323", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "destination_type": "local"}, {"source_type": "volume", "uuid": "a58c219d-6165-465b-a44c-dd79da178951", "destination_type": "invalid"}], "networks": [{"uuid": "092e35b9-633d-403b-a777-df3e8c018327"}]}} Apr 12 10:43:09 user devstack@n-api.service[61853]: method: > Apr 12 10:43:09 user devstack@n-api.service[61853]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 10:43:09 user devstack@n-api.service[61853]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-368348323', 'imageRef': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'a58c219d-6165-465b-a44c-dd79da178951', 'destination_type': 'invalid'}], 'networks': [{'uuid': '092e35b9-633d-403b-a777-df3e8c018327'}]}}} Apr 12 10:43:09 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise error Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi 'invalid' Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 10:43:09 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:43:09 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a5cd9b4b-b729-47b9-bcc9-b5d21f9d276b tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:43:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a5cd9b4b-b729-47b9-bcc9-b5d21f9d276b tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.009022 Apr 12 10:43:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 150/462] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:43:09 2023] POST /compute/v2.1/servers => generated 155 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:43:09 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-eef91ecc-05d8-4316-98f0-2a000c837ac9 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:43:09 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-eef91ecc-05d8-4316-98f0-2a000c837ac9 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:09 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eef91ecc-05d8-4316-98f0-2a000c837ac9 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eef91ecc-05d8-4316-98f0-2a000c837ac9 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eef91ecc-05d8-4316-98f0-2a000c837ac9 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eef91ecc-05d8-4316-98f0-2a000c837ac9 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eef91ecc-05d8-4316-98f0-2a000c837ac9 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eef91ecc-05d8-4316-98f0-2a000c837ac9 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:09 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=28 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:09 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-eef91ecc-05d8-4316-98f0-2a000c837ac9 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d19bfc4894401cb664521438338b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024682bfda5548b8b9b404c85dd55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:43:09 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-eef91ecc-05d8-4316-98f0-2a000c837ac9 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586" status: 200 len: 1492 microversion: 2.1 time: 0.212107 Apr 12 10:43:09 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 159/463] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:43:09 2023] GET /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586 => generated 1492 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:43:14 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:43:14 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:14 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:14 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:43:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aec86031-be71-4a8f-a8ad-cf04c506fdb4" status: 204 len: 0 microversion: 2.1 time: 0.116859 Apr 12 10:43:14 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 155/464] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:43:14 2023] DELETE /compute/v2.1/servers/aec86031-be71-4a8f-a8ad-cf04c506fdb4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 10:43:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a208a76f-b699-4f83-bc76-f90a967dafad tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:43:14 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a208a76f-b699-4f83-bc76-f90a967dafad tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:14 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a208a76f-b699-4f83-bc76-f90a967dafad tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a208a76f-b699-4f83-bc76-f90a967dafad tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a208a76f-b699-4f83-bc76-f90a967dafad tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a208a76f-b699-4f83-bc76-f90a967dafad tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a208a76f-b699-4f83-bc76-f90a967dafad tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a208a76f-b699-4f83-bc76-f90a967dafad tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:14 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-a208a76f-b699-4f83-bc76-f90a967dafad tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccad0e37147441cb68130a22197a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bb70c871154a14947ea3421553a229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:43:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a208a76f-b699-4f83-bc76-f90a967dafad tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aec86031-be71-4a8f-a8ad-cf04c506fdb4" status: 200 len: 1491 microversion: 2.1 time: 0.271607 Apr 12 10:43:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 151/465] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:43:14 2023] GET /compute/v2.1/servers/aec86031-be71-4a8f-a8ad-cf04c506fdb4 => generated 1491 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:43:14 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-8ef1b684-2b85-4f20-9f1d-eee85fd1e84f req-d31e5be1-27ec-4406-8d67-6b3ad76e6e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec86031-be71-4a8f-a8ad-cf04c506fdb4", "name": "network-vif-unplugged", "status": "completed", "tag": "ad98480a-be93-49cd-8de6-0678546d7f68"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:43:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8ef1b684-2b85-4f20-9f1d-eee85fd1e84f req-d31e5be1-27ec-4406-8d67-6b3ad76e6e78 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8ef1b684-2b85-4f20-9f1d-eee85fd1e84f req-d31e5be1-27ec-4406-8d67-6b3ad76e6e78 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8ef1b684-2b85-4f20-9f1d-eee85fd1e84f req-d31e5be1-27ec-4406-8d67-6b3ad76e6e78 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-8ef1b684-2b85-4f20-9f1d-eee85fd1e84f req-d31e5be1-27ec-4406-8d67-6b3ad76e6e78 service nova] Creating event network-vif-unplugged:ad98480a-be93-49cd-8de6-0678546d7f68 for instance aec86031-be71-4a8f-a8ad-cf04c506fdb4 on user Apr 12 10:43:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-8ef1b684-2b85-4f20-9f1d-eee85fd1e84f req-d31e5be1-27ec-4406-8d67-6b3ad76e6e78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045865 Apr 12 10:43:14 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 160/466] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:43:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:43:15 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-d526a87d-4889-49fc-9470-01a9f62e31aa req-cb0b1bde-0b07-445b-b98e-f541002d5246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec86031-be71-4a8f-a8ad-cf04c506fdb4", "name": "network-vif-deleted", "tag": "ad98480a-be93-49cd-8de6-0678546d7f68"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:43:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d526a87d-4889-49fc-9470-01a9f62e31aa req-cb0b1bde-0b07-445b-b98e-f541002d5246 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d526a87d-4889-49fc-9470-01a9f62e31aa req-cb0b1bde-0b07-445b-b98e-f541002d5246 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d526a87d-4889-49fc-9470-01a9f62e31aa req-cb0b1bde-0b07-445b-b98e-f541002d5246 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-d526a87d-4889-49fc-9470-01a9f62e31aa req-cb0b1bde-0b07-445b-b98e-f541002d5246 service nova] Creating event network-vif-deleted:ad98480a-be93-49cd-8de6-0678546d7f68 for instance aec86031-be71-4a8f-a8ad-cf04c506fdb4 on user Apr 12 10:43:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-d526a87d-4889-49fc-9470-01a9f62e31aa req-cb0b1bde-0b07-445b-b98e-f541002d5246 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030181 Apr 12 10:43:15 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 156/467] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:43:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:43:16 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-950433bc-f892-4514-9ddb-a9c082b7cd35 req-c1a42f15-5611-4072-89d0-fcb55090be3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec86031-be71-4a8f-a8ad-cf04c506fdb4", "name": "network-vif-plugged", "status": "completed", "tag": "ad98480a-be93-49cd-8de6-0678546d7f68"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:43:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-950433bc-f892-4514-9ddb-a9c082b7cd35 req-c1a42f15-5611-4072-89d0-fcb55090be3d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-950433bc-f892-4514-9ddb-a9c082b7cd35 req-c1a42f15-5611-4072-89d0-fcb55090be3d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-950433bc-f892-4514-9ddb-a9c082b7cd35 req-c1a42f15-5611-4072-89d0-fcb55090be3d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:16 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-950433bc-f892-4514-9ddb-a9c082b7cd35 req-c1a42f15-5611-4072-89d0-fcb55090be3d service nova] Creating event network-vif-plugged:ad98480a-be93-49cd-8de6-0678546d7f68 for instance aec86031-be71-4a8f-a8ad-cf04c506fdb4 on user Apr 12 10:43:16 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-950433bc-f892-4514-9ddb-a9c082b7cd35 req-c1a42f15-5611-4072-89d0-fcb55090be3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031577 Apr 12 10:43:16 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 152/468] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:43:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:43:17 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9f035889-17ed-4f03-8041-f0f21bc4fcbd tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:43:17 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9f035889-17ed-4f03-8041-f0f21bc4fcbd tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9f035889-17ed-4f03-8041-f0f21bc4fcbd tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9f035889-17ed-4f03-8041-f0f21bc4fcbd tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9f035889-17ed-4f03-8041-f0f21bc4fcbd tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9f035889-17ed-4f03-8041-f0f21bc4fcbd tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9f035889-17ed-4f03-8041-f0f21bc4fcbd tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9f035889-17ed-4f03-8041-f0f21bc4fcbd tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:18 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-9f035889-17ed-4f03-8041-f0f21bc4fcbd tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:43:18 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-9f035889-17ed-4f03-8041-f0f21bc4fcbd tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:43:18 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-9f035889-17ed-4f03-8041-f0f21bc4fcbd tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:43:18 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9f035889-17ed-4f03-8041-f0f21bc4fcbd tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa" status: 200 len: 1783 microversion: 2.20 time: 0.155374 Apr 12 10:43:18 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 161/469] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:43:17 2023] GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa => generated 1783 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:43:18 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a60dc03-9e48-4969-bd52-c5702fc098c7", "device": "/dev/vdb"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:43:18 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:19 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7f834736-e836-49d3-b931-83ad82bef8f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.374539 Apr 12 10:43:19 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 157/470] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:43:18 2023] POST /compute/v2.1/servers/7f834736-e836-49d3-b931-83ad82bef8f3/os-volume_attachments => generated 194 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:43:29 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:29 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=15 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:29 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-26cbff2b-d308-4b0d-b520-0f908bda9f99 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:43:29 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-26cbff2b-d308-4b0d-b520-0f908bda9f99 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-26cbff2b-d308-4b0d-b520-0f908bda9f99 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-26cbff2b-d308-4b0d-b520-0f908bda9f99 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-26cbff2b-d308-4b0d-b520-0f908bda9f99 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-26cbff2b-d308-4b0d-b520-0f908bda9f99 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-26cbff2b-d308-4b0d-b520-0f908bda9f99 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-26cbff2b-d308-4b0d-b520-0f908bda9f99 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-26cbff2b-d308-4b0d-b520-0f908bda9f99 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] HTTP exception thrown: Instance f47d368e-3870-49d0-8522-a94991ec4ba5 could not be found. Apr 12 10:43:29 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-26cbff2b-d308-4b0d-b520-0f908bda9f99 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Request method failure captured: Apr 12 10:43:29 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5 HTTP/1.1 Apr 12 10:43:29 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:43:29 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:43:29 user devstack@n-api.service[61853]: Connection: close Apr 12 10:43:29 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:43:29 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:43:29 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:43:29 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:43:29 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:43:29 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolprZmlTY4J-F0w8y19YlIyg6A66klHRY2_toa1Shr5d7k7aliZgIcPEcOv6k5De2K94oTEgZGj_17fGQGZiRA1QH5_V53jtK2bVz9zLtKJdM4catqw3mp3jsIdb7KfgIuoaUVQzEP5OQmbruthUA2FVycS7AmO3K6cnzyT_axlO4Q Apr 12 10:43:29 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:43:29 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:43:29 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:43:29 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:43:29 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:43:29 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:43:29 user devstack@n-api.service[61853]: X-Project-Id: 8ce2a3bde13e464f8df0a41f30c240ab Apr 12 10:43:29 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1030861486 Apr 12 10:43:29 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:43:29 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:43:29 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8ce2a3bde13e464f8df0a41f30c240ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8ce2a3bde13e464f8df0a41f30c240ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8ce2a3bde13e464f8df0a41f30c240ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:43:29 user devstack@n-api.service[61853]: X-Tenant: tempest-ServerStableDeviceRescueTest-1030861486 Apr 12 10:43:29 user devstack@n-api.service[61853]: X-Tenant-Id: 8ce2a3bde13e464f8df0a41f30c240ab Apr 12 10:43:29 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1030861486 Apr 12 10:43:29 user devstack@n-api.service[61853]: X-User: tempest-ServerStableDeviceRescueTest-1030861486-project-member Apr 12 10:43:29 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:43:29 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:43:29 user devstack@n-api.service[61853]: X-User-Id: c757f04065b9488ba75739e59d7be377 Apr 12 10:43:29 user devstack@n-api.service[61853]: X-User-Name: tempest-ServerStableDeviceRescueTest-1030861486-project-member Apr 12 10:43:29 user devstack@n-api.service[61853]: method: > Apr 12 10:43:29 user devstack@n-api.service[61853]: exception: Instance f47d368e-3870-49d0-8522-a94991ec4ba5 could not be found. Apr 12 10:43:29 user devstack@n-api.service[61853]: action_args: {'id': 'f47d368e-3870-49d0-8522-a94991ec4ba5'} Apr 12 10:43:29 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f47d368e-3870-49d0-8522-a94991ec4ba5 could not be found. Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f47d368e-3870-49d0-8522-a94991ec4ba5 could not be found. Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f47d368e-3870-49d0-8522-a94991ec4ba5 could not be found. Apr 12 10:43:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:43:29 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-26cbff2b-d308-4b0d-b520-0f908bda9f99 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Returning 404 to user: Instance f47d368e-3870-49d0-8522-a94991ec4ba5 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:43:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-26cbff2b-d308-4b0d-b520-0f908bda9f99 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5" status: 404 len: 111 microversion: 2.1 time: 0.037941 Apr 12 10:43:29 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 153/471] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:43:29 2023] GET /compute/v2.1/servers/f47d368e-3870-49d0-8522-a94991ec4ba5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:43:29 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f4faa249-efce-4b90-b61e-7759520a0195 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Calling method '.version_select at 0x7fabbf7d03a0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:43:29 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=5 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:29 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=13 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f4faa249-efce-4b90-b61e-7759520a0195 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741756118" status: 202 len: 0 microversion: 2.1 time: 0.038394 Apr 12 10:43:29 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 162/472] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 10:43:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741756118 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:43:30 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:30 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:30 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-0530e664-3d8e-4d32-96cd-23c05c006ba1 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:43:30 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-0530e664-3d8e-4d32-96cd-23c05c006ba1 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:30 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0530e664-3d8e-4d32-96cd-23c05c006ba1 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:30 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0530e664-3d8e-4d32-96cd-23c05c006ba1 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:30 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0530e664-3d8e-4d32-96cd-23c05c006ba1 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:30 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0530e664-3d8e-4d32-96cd-23c05c006ba1 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:30 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0530e664-3d8e-4d32-96cd-23c05c006ba1 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:30 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0530e664-3d8e-4d32-96cd-23c05c006ba1 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:30 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-0530e664-3d8e-4d32-96cd-23c05c006ba1 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574af27cae41457c9be3d5d50d347b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef7aa45de34b01a97b6bc5e0acece5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:43:30 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-0530e664-3d8e-4d32-96cd-23c05c006ba1 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e" status: 200 len: 1432 microversion: 2.1 time: 0.235875 Apr 12 10:43:30 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 158/473] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:43:30 2023] GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e => generated 1432 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:43:32 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-a4e15034-70ab-4899-b2e4-7ed77eea29df req-328bfbd0-4be4-482b-bfdd-3ff5e224ac85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b29390-867e-4bf3-bc93-b401f32b130e", "tag": "78a8426a-653a-44cb-80b7-8a8b14d78cf4"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:43:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a4e15034-70ab-4899-b2e4-7ed77eea29df req-328bfbd0-4be4-482b-bfdd-3ff5e224ac85 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a4e15034-70ab-4899-b2e4-7ed77eea29df req-328bfbd0-4be4-482b-bfdd-3ff5e224ac85 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a4e15034-70ab-4899-b2e4-7ed77eea29df req-328bfbd0-4be4-482b-bfdd-3ff5e224ac85 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:32 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-a4e15034-70ab-4899-b2e4-7ed77eea29df req-328bfbd0-4be4-482b-bfdd-3ff5e224ac85 service nova] Creating event network-changed:78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance 68b29390-867e-4bf3-bc93-b401f32b130e on user Apr 12 10:43:32 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-a4e15034-70ab-4899-b2e4-7ed77eea29df req-328bfbd0-4be4-482b-bfdd-3ff5e224ac85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039403 Apr 12 10:43:32 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 154/474] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:43:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:43:32 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:43:32 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:32 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lazy-loading 'flavor' on Instance uuid 68b29390-867e-4bf3-bc93-b401f32b130e {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:43:32 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] 10.0.0.210 "POST /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e/action" status: 202 len: 0 microversion: 2.1 time: 0.114595 Apr 12 10:43:32 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 163/475] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:43:32 2023] POST /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:43:32 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-7bccce28-6c10-453f-9fcd-1be2ba82df90 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:43:32 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-7bccce28-6c10-453f-9fcd-1be2ba82df90 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7bccce28-6c10-453f-9fcd-1be2ba82df90 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7bccce28-6c10-453f-9fcd-1be2ba82df90 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7bccce28-6c10-453f-9fcd-1be2ba82df90 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7bccce28-6c10-453f-9fcd-1be2ba82df90 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7bccce28-6c10-453f-9fcd-1be2ba82df90 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7bccce28-6c10-453f-9fcd-1be2ba82df90 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:32 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-a6dc9ea9-7e0e-41f9-b689-49149f5a6309 req-48e16da0-6d74-499b-aefd-28381b271046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b29390-867e-4bf3-bc93-b401f32b130e", "name": "network-vif-unplugged", "status": "completed", "tag": "78a8426a-653a-44cb-80b7-8a8b14d78cf4"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:43:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a6dc9ea9-7e0e-41f9-b689-49149f5a6309 req-48e16da0-6d74-499b-aefd-28381b271046 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a6dc9ea9-7e0e-41f9-b689-49149f5a6309 req-48e16da0-6d74-499b-aefd-28381b271046 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a6dc9ea9-7e0e-41f9-b689-49149f5a6309 req-48e16da0-6d74-499b-aefd-28381b271046 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:32 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-a6dc9ea9-7e0e-41f9-b689-49149f5a6309 req-48e16da0-6d74-499b-aefd-28381b271046 service nova] Creating event network-vif-unplugged:78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance 68b29390-867e-4bf3-bc93-b401f32b130e on user Apr 12 10:43:32 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-a6dc9ea9-7e0e-41f9-b689-49149f5a6309 req-48e16da0-6d74-499b-aefd-28381b271046 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031818 Apr 12 10:43:32 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 155/476] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:43:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:43:32 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-7bccce28-6c10-453f-9fcd-1be2ba82df90 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574af27cae41457c9be3d5d50d347b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef7aa45de34b01a97b6bc5e0acece5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:43:32 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-7bccce28-6c10-453f-9fcd-1be2ba82df90 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e" status: 200 len: 1438 microversion: 2.1 time: 0.364982 Apr 12 10:43:32 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 159/477] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:43:32 2023] GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e => generated 1438 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:43:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-bd34793c-1eef-4df8-aaba-bad0d47a8a46 req-e932759d-90b8-4dbc-b745-6f6fb478474a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b29390-867e-4bf3-bc93-b401f32b130e", "name": "network-vif-plugged", "status": "completed", "tag": "78a8426a-653a-44cb-80b7-8a8b14d78cf4"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:43:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-bd34793c-1eef-4df8-aaba-bad0d47a8a46 req-e932759d-90b8-4dbc-b745-6f6fb478474a service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-bd34793c-1eef-4df8-aaba-bad0d47a8a46 req-e932759d-90b8-4dbc-b745-6f6fb478474a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-bd34793c-1eef-4df8-aaba-bad0d47a8a46 req-e932759d-90b8-4dbc-b745-6f6fb478474a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-bd34793c-1eef-4df8-aaba-bad0d47a8a46 req-e932759d-90b8-4dbc-b745-6f6fb478474a service nova] Creating event network-vif-plugged:78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance 68b29390-867e-4bf3-bc93-b401f32b130e on user Apr 12 10:43:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-bd34793c-1eef-4df8-aaba-bad0d47a8a46 req-e932759d-90b8-4dbc-b745-6f6fb478474a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042373 Apr 12 10:43:34 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 164/478] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:43:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:43:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-f7d0e612-5903-4029-8e37-9978adab1dcf req-f9202644-c5a4-4f3b-aea2-afd03cba196d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b29390-867e-4bf3-bc93-b401f32b130e", "tag": "78a8426a-653a-44cb-80b7-8a8b14d78cf4"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:43:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f7d0e612-5903-4029-8e37-9978adab1dcf req-f9202644-c5a4-4f3b-aea2-afd03cba196d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f7d0e612-5903-4029-8e37-9978adab1dcf req-f9202644-c5a4-4f3b-aea2-afd03cba196d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f7d0e612-5903-4029-8e37-9978adab1dcf req-f9202644-c5a4-4f3b-aea2-afd03cba196d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-f7d0e612-5903-4029-8e37-9978adab1dcf req-f9202644-c5a4-4f3b-aea2-afd03cba196d service nova] Creating event network-changed:78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance 68b29390-867e-4bf3-bc93-b401f32b130e on user Apr 12 10:43:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-f7d0e612-5903-4029-8e37-9978adab1dcf req-f9202644-c5a4-4f3b-aea2-afd03cba196d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041017 Apr 12 10:43:34 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 156/479] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:43:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:43:37 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-b24ee9a0-ea69-4c86-b64b-6b035eb2eb66 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:43:37 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-b24ee9a0-ea69-4c86-b64b-6b035eb2eb66 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:37 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b24ee9a0-ea69-4c86-b64b-6b035eb2eb66 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:37 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b24ee9a0-ea69-4c86-b64b-6b035eb2eb66 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:37 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b24ee9a0-ea69-4c86-b64b-6b035eb2eb66 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:37 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b24ee9a0-ea69-4c86-b64b-6b035eb2eb66 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:37 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b24ee9a0-ea69-4c86-b64b-6b035eb2eb66 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:37 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b24ee9a0-ea69-4c86-b64b-6b035eb2eb66 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:37 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-b24ee9a0-ea69-4c86-b64b-6b035eb2eb66 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec47d3cdacb45e5a39509e76b546e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cecbfbfd5f42dbb663367f6fbdf3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:43:37 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-b24ee9a0-ea69-4c86-b64b-6b035eb2eb66 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683" status: 200 len: 1543 microversion: 2.1 time: 0.145580 Apr 12 10:43:37 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 160/480] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:43:37 2023] GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683 => generated 1543 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:43:37 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:43:37 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:37 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lazy-loading 'services' on Instance uuid 7f834736-e836-49d3-b931-83ad82bef8f3 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:43:37 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7f834736-e836-49d3-b931-83ad82bef8f3/os-volume_attachments/5a60dc03-9e48-4969-bd52-c5702fc098c7" status: 202 len: 0 microversion: 2.1 time: 0.174737 Apr 12 10:43:37 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 165/481] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 10:43:37 2023] DELETE /compute/v2.1/servers/7f834736-e836-49d3-b931-83ad82bef8f3/os-volume_attachments/5a60dc03-9e48-4969-bd52-c5702fc098c7 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:43:37 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:43:37 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:37 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:43:38 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7f834736-e836-49d3-b931-83ad82bef8f3" status: 204 len: 0 microversion: 2.1 time: 0.122515 Apr 12 10:43:38 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 157/482] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:43:37 2023] DELETE /compute/v2.1/servers/7f834736-e836-49d3-b931-83ad82bef8f3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:43:38 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-3d5fb159-083d-4e61-92b1-211e6edb7bde tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:43:38 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-3d5fb159-083d-4e61-92b1-211e6edb7bde tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d5fb159-083d-4e61-92b1-211e6edb7bde tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d5fb159-083d-4e61-92b1-211e6edb7bde tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d5fb159-083d-4e61-92b1-211e6edb7bde tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d5fb159-083d-4e61-92b1-211e6edb7bde tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d5fb159-083d-4e61-92b1-211e6edb7bde tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d5fb159-083d-4e61-92b1-211e6edb7bde tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:38 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-3d5fb159-083d-4e61-92b1-211e6edb7bde tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c97c57a3e7142d088e1cf315f5d8d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16de154a6d344b18a939c6a1b1a679f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:43:38 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-3d5fb159-083d-4e61-92b1-211e6edb7bde tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f834736-e836-49d3-b931-83ad82bef8f3" status: 200 len: 1549 microversion: 2.1 time: 0.143770 Apr 12 10:43:38 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 161/483] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:43:38 2023] GET /compute/v2.1/servers/7f834736-e836-49d3-b931-83ad82bef8f3 => generated 1549 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:43:39 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-2223ad87-2bca-4ff1-95ce-3ae5aa60492d req-3a1d56c3-5c02-4f1c-bca1-b57c1ea7929a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f834736-e836-49d3-b931-83ad82bef8f3", "name": "network-vif-unplugged", "status": "completed", "tag": "28905d4a-0e25-4d67-bab4-ee310dd9eea8"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:43:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2223ad87-2bca-4ff1-95ce-3ae5aa60492d req-3a1d56c3-5c02-4f1c-bca1-b57c1ea7929a service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2223ad87-2bca-4ff1-95ce-3ae5aa60492d req-3a1d56c3-5c02-4f1c-bca1-b57c1ea7929a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2223ad87-2bca-4ff1-95ce-3ae5aa60492d req-3a1d56c3-5c02-4f1c-bca1-b57c1ea7929a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-2223ad87-2bca-4ff1-95ce-3ae5aa60492d req-3a1d56c3-5c02-4f1c-bca1-b57c1ea7929a service nova] Creating event network-vif-unplugged:28905d4a-0e25-4d67-bab4-ee310dd9eea8 for instance 7f834736-e836-49d3-b931-83ad82bef8f3 on user Apr 12 10:43:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-2223ad87-2bca-4ff1-95ce-3ae5aa60492d req-3a1d56c3-5c02-4f1c-bca1-b57c1ea7929a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031516 Apr 12 10:43:39 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 166/484] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:43:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:43:41 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-0451c7b4-d797-440d-ab6a-97ff01288eac req-1d1c9da8-1d37-425a-94df-8570f68395ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f834736-e836-49d3-b931-83ad82bef8f3", "name": "network-vif-plugged", "status": "completed", "tag": "28905d4a-0e25-4d67-bab4-ee310dd9eea8"}, {"server_uuid": "7f834736-e836-49d3-b931-83ad82bef8f3", "name": "network-vif-deleted", "tag": "28905d4a-0e25-4d67-bab4-ee310dd9eea8"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:43:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0451c7b4-d797-440d-ab6a-97ff01288eac req-1d1c9da8-1d37-425a-94df-8570f68395ff service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0451c7b4-d797-440d-ab6a-97ff01288eac req-1d1c9da8-1d37-425a-94df-8570f68395ff service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0451c7b4-d797-440d-ab6a-97ff01288eac req-1d1c9da8-1d37-425a-94df-8570f68395ff service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-0451c7b4-d797-440d-ab6a-97ff01288eac req-1d1c9da8-1d37-425a-94df-8570f68395ff service nova] Creating event network-vif-plugged:28905d4a-0e25-4d67-bab4-ee310dd9eea8 for instance 7f834736-e836-49d3-b931-83ad82bef8f3 on user Apr 12 10:43:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-0451c7b4-d797-440d-ab6a-97ff01288eac req-1d1c9da8-1d37-425a-94df-8570f68395ff service nova] Creating event network-vif-deleted:28905d4a-0e25-4d67-bab4-ee310dd9eea8 for instance 7f834736-e836-49d3-b931-83ad82bef8f3 on user Apr 12 10:43:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-0451c7b4-d797-440d-ab6a-97ff01288eac req-1d1c9da8-1d37-425a-94df-8570f68395ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033978 Apr 12 10:43:42 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 158/485] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:43:41 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:43:42 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-0d87161a-edda-4852-a973-9f19aa87b9b9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:43:42 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-0d87161a-edda-4852-a973-9f19aa87b9b9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0d87161a-edda-4852-a973-9f19aa87b9b9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0d87161a-edda-4852-a973-9f19aa87b9b9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0d87161a-edda-4852-a973-9f19aa87b9b9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0d87161a-edda-4852-a973-9f19aa87b9b9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0d87161a-edda-4852-a973-9f19aa87b9b9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0d87161a-edda-4852-a973-9f19aa87b9b9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:42 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-0d87161a-edda-4852-a973-9f19aa87b9b9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:43:42 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-0d87161a-edda-4852-a973-9f19aa87b9b9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97bafe22-36bf-4939-baf8-9602551bad52" status: 200 len: 1503 microversion: 2.1 time: 0.138678 Apr 12 10:43:42 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 162/486] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:43:42 2023] GET /compute/v2.1/servers/97bafe22-36bf-4939-baf8-9602551bad52 => generated 1503 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:43:55 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1485644091", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "networks": [{"uuid": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e"}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:43:55 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:55 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:55 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] validate_networks() for [('49a2fb41-5e5e-4d4b-969a-0043778b4b0e', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:43:56 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:43:56 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:43:56 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:43:56 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:43:56 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:43:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:56 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Getting quotas for project 3789b59ccc704f86afac83af21fd84f9. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:43:56 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Getting quotas for user ba49b947c74e48f3b161b6f9fce8b1c5 and project 3789b59ccc704f86afac83af21fd84f9. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:43:56 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:43:56 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:43:56 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.507820 Apr 12 10:43:56 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 167/487] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 10:43:55 2023] POST /compute/v2.1/servers => generated 378 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 10:43:56 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:56 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:56 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-fffeb5c6-15e6-47c9-8ad0-597b0ddc01d8 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:43:56 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-fffeb5c6-15e6-47c9-8ad0-597b0ddc01d8 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:43:56 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-fffeb5c6-15e6-47c9-8ad0-597b0ddc01d8 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:43:56 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-fffeb5c6-15e6-47c9-8ad0-597b0ddc01d8 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:43:56 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-fffeb5c6-15e6-47c9-8ad0-597b0ddc01d8 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:43:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-fffeb5c6-15e6-47c9-8ad0-597b0ddc01d8 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" status: 200 len: 1395 microversion: 2.87 time: 0.100608 Apr 12 10:43:56 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 159/488] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:43:56 2023] GET /compute/v2.1/servers/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 => generated 1395 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:43:58 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-b5fb0f7c-afa4-4a68-a86b-cf3a62b5c523 req-06cedd06-3033-4a01-b5e3-9b0bce27a5cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6", "tag": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:43:58 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=10 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:58 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=30 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:43:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-b5fb0f7c-afa4-4a68-a86b-cf3a62b5c523 req-06cedd06-3033-4a01-b5e3-9b0bce27a5cd service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:43:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-b5fb0f7c-afa4-4a68-a86b-cf3a62b5c523 req-06cedd06-3033-4a01-b5e3-9b0bce27a5cd service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:43:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-b5fb0f7c-afa4-4a68-a86b-cf3a62b5c523 req-06cedd06-3033-4a01-b5e3-9b0bce27a5cd service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:43:58 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-b5fb0f7c-afa4-4a68-a86b-cf3a62b5c523 req-06cedd06-3033-4a01-b5e3-9b0bce27a5cd service nova] Creating event network-changed:ce57bd29-c20b-4373-8e1c-724a3cf51fb0 for instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 on user Apr 12 10:43:58 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-b5fb0f7c-afa4-4a68-a86b-cf3a62b5c523 req-06cedd06-3033-4a01-b5e3-9b0bce27a5cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035448 Apr 12 10:43:58 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 163/489] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:43:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-a75f878a-ca06-4eee-9f62-b17ec5b3abd9 req-a3da756c-14c5-4f15-a754-dbe2e81090b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6", "name": "network-vif-plugged", "status": "completed", "tag": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a75f878a-ca06-4eee-9f62-b17ec5b3abd9 req-a3da756c-14c5-4f15-a754-dbe2e81090b2 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a75f878a-ca06-4eee-9f62-b17ec5b3abd9 req-a3da756c-14c5-4f15-a754-dbe2e81090b2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a75f878a-ca06-4eee-9f62-b17ec5b3abd9 req-a3da756c-14c5-4f15-a754-dbe2e81090b2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-a75f878a-ca06-4eee-9f62-b17ec5b3abd9 req-a3da756c-14c5-4f15-a754-dbe2e81090b2 service nova] Creating event network-vif-plugged:ce57bd29-c20b-4373-8e1c-724a3cf51fb0 for instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 on user Apr 12 10:44:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-a75f878a-ca06-4eee-9f62-b17ec5b3abd9 req-a3da756c-14c5-4f15-a754-dbe2e81090b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029193 Apr 12 10:44:00 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 168/490] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:02 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-e6e52644-f094-4262-8f5a-e052ef4f7fd6 req-efb93410-c6fa-4977-88c4-6420b54e2a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6", "name": "network-vif-plugged", "status": "completed", "tag": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e6e52644-f094-4262-8f5a-e052ef4f7fd6 req-efb93410-c6fa-4977-88c4-6420b54e2a6d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e6e52644-f094-4262-8f5a-e052ef4f7fd6 req-efb93410-c6fa-4977-88c4-6420b54e2a6d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e6e52644-f094-4262-8f5a-e052ef4f7fd6 req-efb93410-c6fa-4977-88c4-6420b54e2a6d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e6e52644-f094-4262-8f5a-e052ef4f7fd6 req-efb93410-c6fa-4977-88c4-6420b54e2a6d service nova] Creating event network-vif-plugged:ce57bd29-c20b-4373-8e1c-724a3cf51fb0 for instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 on user Apr 12 10:44:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-e6e52644-f094-4262-8f5a-e052ef4f7fd6 req-efb93410-c6fa-4977-88c4-6420b54e2a6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041051 Apr 12 10:44:02 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 160/491] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:04 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-93143597-5cdd-4e85-847c-9e33e03c2ca5 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:04 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-93143597-5cdd-4e85-847c-9e33e03c2ca5 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-93143597-5cdd-4e85-847c-9e33e03c2ca5 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-93143597-5cdd-4e85-847c-9e33e03c2ca5 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-93143597-5cdd-4e85-847c-9e33e03c2ca5 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-93143597-5cdd-4e85-847c-9e33e03c2ca5 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-93143597-5cdd-4e85-847c-9e33e03c2ca5 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-93143597-5cdd-4e85-847c-9e33e03c2ca5 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:04 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-93143597-5cdd-4e85-847c-9e33e03c2ca5 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] HTTP exception thrown: Instance aec86031-be71-4a8f-a8ad-cf04c506fdb4 could not be found. Apr 12 10:44:04 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-93143597-5cdd-4e85-847c-9e33e03c2ca5 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Request method failure captured: Apr 12 10:44:04 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/aec86031-be71-4a8f-a8ad-cf04c506fdb4 HTTP/1.1 Apr 12 10:44:04 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:44:04 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:44:04 user devstack@n-api.service[61852]: Connection: close Apr 12 10:44:04 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:44:04 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:44:04 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:44:04 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:44:04 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:44:04 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNorQoc7u3Xvn57Cv4akmfG7wvpf4MRLYQCt_8MJi4ZhPBJz4HkJ42rgebgBr9ot3mMfh-hLqvwGGKrNAzyFJimoMsdfEyg_T0AXIRB3wJlt2_9mgM6oadlqM3-iOfnfwHg9ayqNgrmylaZkp-A92_bWN3Eu0UG5O9w_MN34lDFH98WE Apr 12 10:44:04 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:44:04 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:44:04 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:44:04 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:44:04 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:44:04 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:44:04 user devstack@n-api.service[61852]: X-Project-Id: 71bb70c871154a14947ea3421553a229 Apr 12 10:44:04 user devstack@n-api.service[61852]: X-Project-Name: tempest-VolumesActionsTest-715093810 Apr 12 10:44:04 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:44:04 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:44:04 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71bb70c871154a14947ea3421553a229"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71bb70c871154a14947ea3421553a229"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71bb70c871154a14947ea3421553a229"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:44:04 user devstack@n-api.service[61852]: X-Tenant: tempest-VolumesActionsTest-715093810 Apr 12 10:44:04 user devstack@n-api.service[61852]: X-Tenant-Id: 71bb70c871154a14947ea3421553a229 Apr 12 10:44:04 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-VolumesActionsTest-715093810 Apr 12 10:44:04 user devstack@n-api.service[61852]: X-User: tempest-VolumesActionsTest-715093810-project-member Apr 12 10:44:04 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:44:04 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:44:04 user devstack@n-api.service[61852]: X-User-Id: bccad0e37147441cb68130a22197a5d4 Apr 12 10:44:04 user devstack@n-api.service[61852]: X-User-Name: tempest-VolumesActionsTest-715093810-project-member Apr 12 10:44:04 user devstack@n-api.service[61852]: method: > Apr 12 10:44:04 user devstack@n-api.service[61852]: exception: Instance aec86031-be71-4a8f-a8ad-cf04c506fdb4 could not be found. Apr 12 10:44:04 user devstack@n-api.service[61852]: action_args: {'id': 'aec86031-be71-4a8f-a8ad-cf04c506fdb4'} Apr 12 10:44:04 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aec86031-be71-4a8f-a8ad-cf04c506fdb4 could not be found. Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aec86031-be71-4a8f-a8ad-cf04c506fdb4 could not be found. Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aec86031-be71-4a8f-a8ad-cf04c506fdb4 could not be found. Apr 12 10:44:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:44:04 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-93143597-5cdd-4e85-847c-9e33e03c2ca5 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Returning 404 to user: Instance aec86031-be71-4a8f-a8ad-cf04c506fdb4 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:44:04 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-93143597-5cdd-4e85-847c-9e33e03c2ca5 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aec86031-be71-4a8f-a8ad-cf04c506fdb4" status: 404 len: 111 microversion: 2.1 time: 0.036786 Apr 12 10:44:04 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 164/492] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:44:04 2023] GET /compute/v2.1/servers/aec86031-be71-4a8f-a8ad-cf04c506fdb4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 10:44:04 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1626749449", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "networks": [{"uuid": "1b1e97a6-2805-47eb-b62a-777fed79a136"}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:04 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] validate_networks() for [('1b1e97a6-2805-47eb-b62a-777fed79a136', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:44:05 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:44:05 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:44:05 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:44:05 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:44:05 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:44:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:05 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Getting quotas for project 71bb70c871154a14947ea3421553a229. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:44:05 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Getting quotas for user bccad0e37147441cb68130a22197a5d4 and project 71bb70c871154a14947ea3421553a229. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:44:05 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:44:05 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:44:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.567552 Apr 12 10:44:05 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 169/493] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:44:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:44:05 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-40aec8f1-0f32-4fb4-b265-18160e442165 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:05 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-40aec8f1-0f32-4fb4-b265-18160e442165 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:05 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-40aec8f1-0f32-4fb4-b265-18160e442165 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccad0e37147441cb68130a22197a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bb70c871154a14947ea3421553a229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:44:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-40aec8f1-0f32-4fb4-b265-18160e442165 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6468f2a7-ce19-468d-8b8f-e6071cf437ff" status: 200 len: 1208 microversion: 2.1 time: 0.078524 Apr 12 10:44:05 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 161/494] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:44:05 2023] GET /compute/v2.1/servers/6468f2a7-ce19-468d-8b8f-e6071cf437ff => generated 1208 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:44:08 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-db8bd8d9-306c-42d0-9e7c-6bf4af8e767f req-9db0f9b0-0c3d-4d4d-8a51-9b7caacb3c4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6468f2a7-ce19-468d-8b8f-e6071cf437ff", "tag": "2970d881-0a68-41b7-a58c-1876abba1236"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-db8bd8d9-306c-42d0-9e7c-6bf4af8e767f req-9db0f9b0-0c3d-4d4d-8a51-9b7caacb3c4d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-db8bd8d9-306c-42d0-9e7c-6bf4af8e767f req-9db0f9b0-0c3d-4d4d-8a51-9b7caacb3c4d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-db8bd8d9-306c-42d0-9e7c-6bf4af8e767f req-9db0f9b0-0c3d-4d4d-8a51-9b7caacb3c4d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:08 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-db8bd8d9-306c-42d0-9e7c-6bf4af8e767f req-9db0f9b0-0c3d-4d4d-8a51-9b7caacb3c4d service nova] Creating event network-changed:2970d881-0a68-41b7-a58c-1876abba1236 for instance 6468f2a7-ce19-468d-8b8f-e6071cf437ff on user Apr 12 10:44:08 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-db8bd8d9-306c-42d0-9e7c-6bf4af8e767f req-9db0f9b0-0c3d-4d4d-8a51-9b7caacb3c4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029741 Apr 12 10:44:08 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 165/495] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f770e268-ba91-46d8-8f30-bb9174e9d877 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:08 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f770e268-ba91-46d8-8f30-bb9174e9d877 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f770e268-ba91-46d8-8f30-bb9174e9d877 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f770e268-ba91-46d8-8f30-bb9174e9d877 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f770e268-ba91-46d8-8f30-bb9174e9d877 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f770e268-ba91-46d8-8f30-bb9174e9d877 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f770e268-ba91-46d8-8f30-bb9174e9d877 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f770e268-ba91-46d8-8f30-bb9174e9d877 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:08 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-f770e268-ba91-46d8-8f30-bb9174e9d877 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:44:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f770e268-ba91-46d8-8f30-bb9174e9d877 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1677 microversion: 2.1 time: 0.155994 Apr 12 10:44:08 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 170/496] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:44:08 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:44:09 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84e79e7d-5eb0-4960-b9ba-ff1afd54aa61"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:09 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313304 Apr 12 10:44:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 162/497] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:44:09 2023] POST /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:10 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-cbdba9e1-c992-4153-8573-50b9faa7573e req-f9dae36e-0fe9-41c6-8b41-bd6d15455b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6468f2a7-ce19-468d-8b8f-e6071cf437ff", "name": "network-vif-plugged", "status": "completed", "tag": "2970d881-0a68-41b7-a58c-1876abba1236"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-cbdba9e1-c992-4153-8573-50b9faa7573e req-f9dae36e-0fe9-41c6-8b41-bd6d15455b26 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-cbdba9e1-c992-4153-8573-50b9faa7573e req-f9dae36e-0fe9-41c6-8b41-bd6d15455b26 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-cbdba9e1-c992-4153-8573-50b9faa7573e req-f9dae36e-0fe9-41c6-8b41-bd6d15455b26 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:10 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-cbdba9e1-c992-4153-8573-50b9faa7573e req-f9dae36e-0fe9-41c6-8b41-bd6d15455b26 service nova] Creating event network-vif-plugged:2970d881-0a68-41b7-a58c-1876abba1236 for instance 6468f2a7-ce19-468d-8b8f-e6071cf437ff on user Apr 12 10:44:10 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-cbdba9e1-c992-4153-8573-50b9faa7573e req-f9dae36e-0fe9-41c6-8b41-bd6d15455b26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029480 Apr 12 10:44:10 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 166/498] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:12 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-3020f423-b639-4073-a9fb-b8f31452abde req-8cb137d7-42da-4335-b7b3-ba20e9aa3291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6468f2a7-ce19-468d-8b8f-e6071cf437ff", "name": "network-vif-plugged", "status": "completed", "tag": "2970d881-0a68-41b7-a58c-1876abba1236"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3020f423-b639-4073-a9fb-b8f31452abde req-8cb137d7-42da-4335-b7b3-ba20e9aa3291 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3020f423-b639-4073-a9fb-b8f31452abde req-8cb137d7-42da-4335-b7b3-ba20e9aa3291 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3020f423-b639-4073-a9fb-b8f31452abde req-8cb137d7-42da-4335-b7b3-ba20e9aa3291 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-3020f423-b639-4073-a9fb-b8f31452abde req-8cb137d7-42da-4335-b7b3-ba20e9aa3291 service nova] Creating event network-vif-plugged:2970d881-0a68-41b7-a58c-1876abba1236 for instance 6468f2a7-ce19-468d-8b8f-e6071cf437ff on user Apr 12 10:44:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-3020f423-b639-4073-a9fb-b8f31452abde req-8cb137d7-42da-4335-b7b3-ba20e9aa3291 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031796 Apr 12 10:44:12 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 171/499] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-19b8afc7-bc73-44b4-b4ca-ba1c0207e4bc tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-19b8afc7-bc73-44b4-b4ca-ba1c0207e4bc tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-19b8afc7-bc73-44b4-b4ca-ba1c0207e4bc tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-19b8afc7-bc73-44b4-b4ca-ba1c0207e4bc tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-19b8afc7-bc73-44b4-b4ca-ba1c0207e4bc tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-19b8afc7-bc73-44b4-b4ca-ba1c0207e4bc tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-19b8afc7-bc73-44b4-b4ca-ba1c0207e4bc tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-19b8afc7-bc73-44b4-b4ca-ba1c0207e4bc tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-19b8afc7-bc73-44b4-b4ca-ba1c0207e4bc tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] HTTP exception thrown: Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 could not be found. Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-19b8afc7-bc73-44b4-b4ca-ba1c0207e4bc tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Request method failure captured: Apr 12 10:44:14 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/893c42b2-83ed-4823-9698-2015a3ffd4c5 HTTP/1.1 Apr 12 10:44:14 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:44:14 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:44:14 user devstack@n-api.service[61853]: Connection: close Apr 12 10:44:14 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:44:14 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:44:14 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:44:14 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:44:14 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:44:14 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolyPj4uP3fUaGvJghQbYB0eJurMk0aTXOP8m_SRC4HCE3RKd0kG4NblpxL-3HoVpVY4fHbUBjkQR9sFtLPZCwY79AY01f-FnXJli2U-y_sg0L5mYp62dEOpZN86j2hPkA0DEz8im88zu7QIITcqH4-51-4fU1cE5F0swgyw4tBPWWI Apr 12 10:44:14 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:44:14 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:44:14 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:44:14 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:44:14 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:44:14 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:44:14 user devstack@n-api.service[61853]: X-Project-Id: 024682bfda5548b8b9b404c85dd55b34 Apr 12 10:44:14 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServersNegativeTestJSON-563292074 Apr 12 10:44:14 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:44:14 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:44:14 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/024682bfda5548b8b9b404c85dd55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/024682bfda5548b8b9b404c85dd55b34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/024682bfda5548b8b9b404c85dd55b34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:44:14 user devstack@n-api.service[61853]: X-Tenant: tempest-ServersNegativeTestJSON-563292074 Apr 12 10:44:14 user devstack@n-api.service[61853]: X-Tenant-Id: 024682bfda5548b8b9b404c85dd55b34 Apr 12 10:44:14 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServersNegativeTestJSON-563292074 Apr 12 10:44:14 user devstack@n-api.service[61853]: X-User: tempest-ServersNegativeTestJSON-563292074-project-member Apr 12 10:44:14 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:44:14 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:44:14 user devstack@n-api.service[61853]: X-User-Id: 33d19bfc4894401cb664521438338b9a Apr 12 10:44:14 user devstack@n-api.service[61853]: X-User-Name: tempest-ServersNegativeTestJSON-563292074-project-member Apr 12 10:44:14 user devstack@n-api.service[61853]: method: > Apr 12 10:44:14 user devstack@n-api.service[61853]: exception: Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 could not be found. Apr 12 10:44:14 user devstack@n-api.service[61853]: action_args: {'id': '893c42b2-83ed-4823-9698-2015a3ffd4c5'} Apr 12 10:44:14 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 could not be found. Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 could not be found. Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 could not be found. Apr 12 10:44:14 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-19b8afc7-bc73-44b4-b4ca-ba1c0207e4bc tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Returning 404 to user: Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:44:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-19b8afc7-bc73-44b4-b4ca-ba1c0207e4bc tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/893c42b2-83ed-4823-9698-2015a3ffd4c5" status: 404 len: 111 microversion: 2.1 time: 0.037320 Apr 12 10:44:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 163/500] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:44:14 2023] DELETE /compute/v2.1/servers/893c42b2-83ed-4823-9698-2015a3ffd4c5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:44:14 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-47ac9644-66f1-4351-8c99-f8a6671da3f5 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:14 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-47ac9644-66f1-4351-8c99-f8a6671da3f5 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-47ac9644-66f1-4351-8c99-f8a6671da3f5 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-47ac9644-66f1-4351-8c99-f8a6671da3f5 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-47ac9644-66f1-4351-8c99-f8a6671da3f5 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-47ac9644-66f1-4351-8c99-f8a6671da3f5 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-47ac9644-66f1-4351-8c99-f8a6671da3f5 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-47ac9644-66f1-4351-8c99-f8a6671da3f5 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-47ac9644-66f1-4351-8c99-f8a6671da3f5 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] HTTP exception thrown: Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 could not be found. Apr 12 10:44:14 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-47ac9644-66f1-4351-8c99-f8a6671da3f5 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Request method failure captured: Apr 12 10:44:14 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/893c42b2-83ed-4823-9698-2015a3ffd4c5 HTTP/1.1 Apr 12 10:44:14 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:44:14 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:44:14 user devstack@n-api.service[61852]: Connection: close Apr 12 10:44:14 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:44:14 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:44:14 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:44:14 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:44:14 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:44:14 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNolyPj4uP3fUaGvJghQbYB0eJurMk0aTXOP8m_SRC4HCE3RKd0kG4NblpxL-3HoVpVY4fHbUBjkQR9sFtLPZCwY79AY01f-FnXJli2U-y_sg0L5mYp62dEOpZN86j2hPkA0DEz8im88zu7QIITcqH4-51-4fU1cE5F0swgyw4tBPWWI Apr 12 10:44:14 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:44:14 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:44:14 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:44:14 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:44:14 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:44:14 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:44:14 user devstack@n-api.service[61852]: X-Project-Id: 024682bfda5548b8b9b404c85dd55b34 Apr 12 10:44:14 user devstack@n-api.service[61852]: X-Project-Name: tempest-ServersNegativeTestJSON-563292074 Apr 12 10:44:14 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:44:14 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:44:14 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/024682bfda5548b8b9b404c85dd55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/024682bfda5548b8b9b404c85dd55b34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/024682bfda5548b8b9b404c85dd55b34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:44:14 user devstack@n-api.service[61852]: X-Tenant: tempest-ServersNegativeTestJSON-563292074 Apr 12 10:44:14 user devstack@n-api.service[61852]: X-Tenant-Id: 024682bfda5548b8b9b404c85dd55b34 Apr 12 10:44:14 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-ServersNegativeTestJSON-563292074 Apr 12 10:44:14 user devstack@n-api.service[61852]: X-User: tempest-ServersNegativeTestJSON-563292074-project-member Apr 12 10:44:14 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:44:14 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:44:14 user devstack@n-api.service[61852]: X-User-Id: 33d19bfc4894401cb664521438338b9a Apr 12 10:44:14 user devstack@n-api.service[61852]: X-User-Name: tempest-ServersNegativeTestJSON-563292074-project-member Apr 12 10:44:14 user devstack@n-api.service[61852]: method: > Apr 12 10:44:14 user devstack@n-api.service[61852]: exception: Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 could not be found. Apr 12 10:44:14 user devstack@n-api.service[61852]: action_args: {'id': '893c42b2-83ed-4823-9698-2015a3ffd4c5'} Apr 12 10:44:14 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 could not be found. Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 could not be found. Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 could not be found. Apr 12 10:44:14 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:44:14 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-47ac9644-66f1-4351-8c99-f8a6671da3f5 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Returning 404 to user: Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:44:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-47ac9644-66f1-4351-8c99-f8a6671da3f5 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/893c42b2-83ed-4823-9698-2015a3ffd4c5" status: 404 len: 111 microversion: 2.1 time: 0.052789 Apr 12 10:44:14 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 167/501] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:44:14 2023] GET /compute/v2.1/servers/893c42b2-83ed-4823-9698-2015a3ffd4c5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:44:14 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:14 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:14 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:44:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586" status: 204 len: 0 microversion: 2.1 time: 0.146279 Apr 12 10:44:14 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 172/502] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:44:14 2023] DELETE /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-789cdcbe-80f0-4cc7-97c0-5f5e514fb429 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-789cdcbe-80f0-4cc7-97c0-5f5e514fb429 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-789cdcbe-80f0-4cc7-97c0-5f5e514fb429 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-789cdcbe-80f0-4cc7-97c0-5f5e514fb429 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-789cdcbe-80f0-4cc7-97c0-5f5e514fb429 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-789cdcbe-80f0-4cc7-97c0-5f5e514fb429 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-789cdcbe-80f0-4cc7-97c0-5f5e514fb429 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-789cdcbe-80f0-4cc7-97c0-5f5e514fb429 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:14 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-789cdcbe-80f0-4cc7-97c0-5f5e514fb429 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d19bfc4894401cb664521438338b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024682bfda5548b8b9b404c85dd55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:44:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-789cdcbe-80f0-4cc7-97c0-5f5e514fb429 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586" status: 200 len: 1498 microversion: 2.1 time: 0.277539 Apr 12 10:44:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 164/503] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:44:14 2023] GET /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586 => generated 1498 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:44:14 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-04e80ced-5fc1-4547-845a-d5f10b605c9a req-d1a108ee-04d6-47d5-b69d-779072b41e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6eb5d4-d415-4459-a95b-5a470ec66586", "name": "network-vif-unplugged", "status": "completed", "tag": "54a35da3-7130-4116-a695-1d7da8f0afc8"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-04e80ced-5fc1-4547-845a-d5f10b605c9a req-d1a108ee-04d6-47d5-b69d-779072b41e1b service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-04e80ced-5fc1-4547-845a-d5f10b605c9a req-d1a108ee-04d6-47d5-b69d-779072b41e1b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-04e80ced-5fc1-4547-845a-d5f10b605c9a req-d1a108ee-04d6-47d5-b69d-779072b41e1b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-04e80ced-5fc1-4547-845a-d5f10b605c9a req-d1a108ee-04d6-47d5-b69d-779072b41e1b service nova] Creating event network-vif-unplugged:54a35da3-7130-4116-a695-1d7da8f0afc8 for instance dc6eb5d4-d415-4459-a95b-5a470ec66586 on user Apr 12 10:44:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-04e80ced-5fc1-4547-845a-d5f10b605c9a req-d1a108ee-04d6-47d5-b69d-779072b41e1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048236 Apr 12 10:44:14 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 168/504] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:16 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-08dc208b-2a30-40c3-b29c-3b60b0af1f59 req-de689d68-d301-4188-b487-824252a6a8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6eb5d4-d415-4459-a95b-5a470ec66586", "name": "network-vif-deleted", "tag": "54a35da3-7130-4116-a695-1d7da8f0afc8"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:16 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:44:16 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=12 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:44:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-08dc208b-2a30-40c3-b29c-3b60b0af1f59 req-de689d68-d301-4188-b487-824252a6a8c8 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-08dc208b-2a30-40c3-b29c-3b60b0af1f59 req-de689d68-d301-4188-b487-824252a6a8c8 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-08dc208b-2a30-40c3-b29c-3b60b0af1f59 req-de689d68-d301-4188-b487-824252a6a8c8 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-08dc208b-2a30-40c3-b29c-3b60b0af1f59 req-de689d68-d301-4188-b487-824252a6a8c8 service nova] Creating event network-vif-deleted:54a35da3-7130-4116-a695-1d7da8f0afc8 for instance dc6eb5d4-d415-4459-a95b-5a470ec66586 on user Apr 12 10:44:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-08dc208b-2a30-40c3-b29c-3b60b0af1f59 req-de689d68-d301-4188-b487-824252a6a8c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077479 Apr 12 10:44:16 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 173/505] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:16 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-ee9a42b9-3c35-4399-9fd3-d863b245e0a1 req-29263133-1d0e-41a8-89af-2259d2aac19b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6eb5d4-d415-4459-a95b-5a470ec66586", "name": "network-vif-plugged", "status": "completed", "tag": "54a35da3-7130-4116-a695-1d7da8f0afc8"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:16 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:44:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ee9a42b9-3c35-4399-9fd3-d863b245e0a1 req-29263133-1d0e-41a8-89af-2259d2aac19b service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ee9a42b9-3c35-4399-9fd3-d863b245e0a1 req-29263133-1d0e-41a8-89af-2259d2aac19b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ee9a42b9-3c35-4399-9fd3-d863b245e0a1 req-29263133-1d0e-41a8-89af-2259d2aac19b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:16 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-ee9a42b9-3c35-4399-9fd3-d863b245e0a1 req-29263133-1d0e-41a8-89af-2259d2aac19b service nova] Creating event network-vif-plugged:54a35da3-7130-4116-a695-1d7da8f0afc8 for instance dc6eb5d4-d415-4459-a95b-5a470ec66586 on user Apr 12 10:44:16 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-ee9a42b9-3c35-4399-9fd3-d863b245e0a1 req-29263133-1d0e-41a8-89af-2259d2aac19b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039510 Apr 12 10:44:16 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 165/506] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Old instance type m1.nano, new instance type m1.micro {{(pid=61852) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting quotas for project 32235c67d269474b879a58269c1bfb28. Resources: {'cores', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting quotas for user 0059d31539304ffcb5214b408751cd4f and project 32235c67d269474b879a58269c1bfb28. Resources: {'cores', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:44:17 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:44:17 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/action" status: 202 len: 0 microversion: 2.1 time: 0.285181 Apr 12 10:44:17 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 169/507] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:44:17 2023] POST /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:44:17 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ffcc0225-a5bc-49bf-a576-2d5f2da4f3f8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:17 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-ffcc0225-a5bc-49bf-a576-2d5f2da4f3f8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ffcc0225-a5bc-49bf-a576-2d5f2da4f3f8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ffcc0225-a5bc-49bf-a576-2d5f2da4f3f8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ffcc0225-a5bc-49bf-a576-2d5f2da4f3f8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ffcc0225-a5bc-49bf-a576-2d5f2da4f3f8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ffcc0225-a5bc-49bf-a576-2d5f2da4f3f8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ffcc0225-a5bc-49bf-a576-2d5f2da4f3f8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:17 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-ffcc0225-a5bc-49bf-a576-2d5f2da4f3f8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:44:17 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ffcc0225-a5bc-49bf-a576-2d5f2da4f3f8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1732 microversion: 2.1 time: 0.194178 Apr 12 10:44:17 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 174/508] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:44:17 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1732 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:44:18 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-28892704-1e1c-49dc-844e-4181abcdfadb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:18 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-28892704-1e1c-49dc-844e-4181abcdfadb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-28892704-1e1c-49dc-844e-4181abcdfadb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-28892704-1e1c-49dc-844e-4181abcdfadb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-28892704-1e1c-49dc-844e-4181abcdfadb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-28892704-1e1c-49dc-844e-4181abcdfadb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-28892704-1e1c-49dc-844e-4181abcdfadb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:18 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-28892704-1e1c-49dc-844e-4181abcdfadb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:18 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-28892704-1e1c-49dc-844e-4181abcdfadb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa/os-volume_attachments/ae5450fe-d7d1-435d-bf24-e15cfd92e3fc" status: 200 len: 194 microversion: 2.20 time: 0.227249 Apr 12 10:44:18 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 166/509] 10.0.0.210 () {64 vars in 1531 bytes} [Wed Apr 12 10:44:18 2023] GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa/os-volume_attachments/ae5450fe-d7d1-435d-bf24-e15cfd92e3fc => generated 194 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:44:18 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:18 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:18 user devstack@n-api.service[61852]: DEBUG nova.objects.instance [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'services' on Instance uuid 0bfafa79-ce40-42f1-9992-10e50734f7fa {{(pid=61852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:44:18 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa/os-volume_attachments/ae5450fe-d7d1-435d-bf24-e15cfd92e3fc" status: 202 len: 0 microversion: 2.20 time: 0.213453 Apr 12 10:44:18 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 170/510] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 10:44:18 2023] DELETE /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa/os-volume_attachments/ae5450fe-d7d1-435d-bf24-e15cfd92e3fc => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:44:18 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-017fb89f-6c51-4332-87f0-a47b03899eaa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:18 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-017fb89f-6c51-4332-87f0-a47b03899eaa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-017fb89f-6c51-4332-87f0-a47b03899eaa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-017fb89f-6c51-4332-87f0-a47b03899eaa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-017fb89f-6c51-4332-87f0-a47b03899eaa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-017fb89f-6c51-4332-87f0-a47b03899eaa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-017fb89f-6c51-4332-87f0-a47b03899eaa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-017fb89f-6c51-4332-87f0-a47b03899eaa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:18 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-017fb89f-6c51-4332-87f0-a47b03899eaa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089867 Apr 12 10:44:18 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 175/511] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 10:44:18 2023] GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:44:19 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-9c026c11-2983-4c18-b20f-e62330cfcf3c req-d572edd8-1b51-4c91-8d1f-0eb89b13680c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-unplugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9c026c11-2983-4c18-b20f-e62330cfcf3c req-d572edd8-1b51-4c91-8d1f-0eb89b13680c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9c026c11-2983-4c18-b20f-e62330cfcf3c req-d572edd8-1b51-4c91-8d1f-0eb89b13680c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9c026c11-2983-4c18-b20f-e62330cfcf3c req-d572edd8-1b51-4c91-8d1f-0eb89b13680c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-9c026c11-2983-4c18-b20f-e62330cfcf3c req-d572edd8-1b51-4c91-8d1f-0eb89b13680c service nova] Creating event network-vif-unplugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:44:19 user devstack@n-api.service[61853]: DEBUG nova.compute.api [req-9c026c11-2983-4c18-b20f-e62330cfcf3c req-d572edd8-1b51-4c91-8d1f-0eb89b13680c service nova] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61853) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 10:44:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-9c026c11-2983-4c18-b20f-e62330cfcf3c req-d572edd8-1b51-4c91-8d1f-0eb89b13680c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057897 Apr 12 10:44:19 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 167/512] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:21 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-ebe484c6-ee07-427c-9aa4-94ca616898c9 req-74bf1469-3887-4545-8f03-c531fa8e51e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-plugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-ebe484c6-ee07-427c-9aa4-94ca616898c9 req-74bf1469-3887-4545-8f03-c531fa8e51e7 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-ebe484c6-ee07-427c-9aa4-94ca616898c9 req-74bf1469-3887-4545-8f03-c531fa8e51e7 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-ebe484c6-ee07-427c-9aa4-94ca616898c9 req-74bf1469-3887-4545-8f03-c531fa8e51e7 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:22 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-ebe484c6-ee07-427c-9aa4-94ca616898c9 req-74bf1469-3887-4545-8f03-c531fa8e51e7 service nova] Creating event network-vif-plugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:44:22 user devstack@n-api.service[61852]: DEBUG nova.compute.api [req-ebe484c6-ee07-427c-9aa4-94ca616898c9 req-74bf1469-3887-4545-8f03-c531fa8e51e7 service nova] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61852) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 10:44:22 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-ebe484c6-ee07-427c-9aa4-94ca616898c9 req-74bf1469-3887-4545-8f03-c531fa8e51e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053294 Apr 12 10:44:22 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 171/513] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-043c2ce4-71b9-4425-a3d8-6dabac6ff97d tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:22 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-043c2ce4-71b9-4425-a3d8-6dabac6ff97d tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-043c2ce4-71b9-4425-a3d8-6dabac6ff97d tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-043c2ce4-71b9-4425-a3d8-6dabac6ff97d tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-043c2ce4-71b9-4425-a3d8-6dabac6ff97d tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-043c2ce4-71b9-4425-a3d8-6dabac6ff97d tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-043c2ce4-71b9-4425-a3d8-6dabac6ff97d tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-043c2ce4-71b9-4425-a3d8-6dabac6ff97d tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:23 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-043c2ce4-71b9-4425-a3d8-6dabac6ff97d tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574af27cae41457c9be3d5d50d347b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef7aa45de34b01a97b6bc5e0acece5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:44:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-043c2ce4-71b9-4425-a3d8-6dabac6ff97d tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e" status: 200 len: 1497 microversion: 2.1 time: 0.159989 Apr 12 10:44:23 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 176/514] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:44:22 2023] GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:44:28 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e82e10ad-6d7a-4e44-abfb-dfe62c14957b tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:28 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-e82e10ad-6d7a-4e44-abfb-dfe62c14957b tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:28 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=25 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:44:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e82e10ad-6d7a-4e44-abfb-dfe62c14957b tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e82e10ad-6d7a-4e44-abfb-dfe62c14957b tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e82e10ad-6d7a-4e44-abfb-dfe62c14957b tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e82e10ad-6d7a-4e44-abfb-dfe62c14957b tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e82e10ad-6d7a-4e44-abfb-dfe62c14957b tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e82e10ad-6d7a-4e44-abfb-dfe62c14957b tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:28 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:44:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-e82e10ad-6d7a-4e44-abfb-dfe62c14957b tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] HTTP exception thrown: Instance 7f834736-e836-49d3-b931-83ad82bef8f3 could not be found. Apr 12 10:44:28 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e82e10ad-6d7a-4e44-abfb-dfe62c14957b tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Request method failure captured: Apr 12 10:44:28 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/7f834736-e836-49d3-b931-83ad82bef8f3 HTTP/1.1 Apr 12 10:44:28 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:44:28 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:44:28 user devstack@n-api.service[61853]: Connection: close Apr 12 10:44:28 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:44:28 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:44:28 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:44:28 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:44:28 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:44:28 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNooKHHzpYV5ukInxPhdDWCJQPMdFxxzDjWCB-hX0gmsLNNB_zjEgoiUt5F-J7f_CQ93pPew5Ssuydcv1GDDEhZ63vVnrp8ZlqnbQo0J83C3obS8b6-kez8-pGMY3gRkg-Tg1m3dzyk4mtMX73Z2ZAPMTU2kXScLXR7uvScqRE-UPWnU Apr 12 10:44:28 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:44:28 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:44:28 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:44:28 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:44:28 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:44:28 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:44:28 user devstack@n-api.service[61853]: X-Project-Id: 16de154a6d344b18a939c6a1b1a679f5 Apr 12 10:44:28 user devstack@n-api.service[61853]: X-Project-Name: tempest-VolumesSnapshotTestJSON-858479648 Apr 12 10:44:28 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:44:28 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:44:28 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/16de154a6d344b18a939c6a1b1a679f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16de154a6d344b18a939c6a1b1a679f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16de154a6d344b18a939c6a1b1a679f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:44:28 user devstack@n-api.service[61853]: X-Tenant: tempest-VolumesSnapshotTestJSON-858479648 Apr 12 10:44:28 user devstack@n-api.service[61853]: X-Tenant-Id: 16de154a6d344b18a939c6a1b1a679f5 Apr 12 10:44:28 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-858479648 Apr 12 10:44:28 user devstack@n-api.service[61853]: X-User: tempest-VolumesSnapshotTestJSON-858479648-project-member Apr 12 10:44:28 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:44:28 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:44:28 user devstack@n-api.service[61853]: X-User-Id: 2c97c57a3e7142d088e1cf315f5d8d72 Apr 12 10:44:28 user devstack@n-api.service[61853]: X-User-Name: tempest-VolumesSnapshotTestJSON-858479648-project-member Apr 12 10:44:28 user devstack@n-api.service[61853]: method: > Apr 12 10:44:28 user devstack@n-api.service[61853]: exception: Instance 7f834736-e836-49d3-b931-83ad82bef8f3 could not be found. Apr 12 10:44:28 user devstack@n-api.service[61853]: action_args: {'id': '7f834736-e836-49d3-b931-83ad82bef8f3'} Apr 12 10:44:28 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f834736-e836-49d3-b931-83ad82bef8f3 could not be found. Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f834736-e836-49d3-b931-83ad82bef8f3 could not be found. Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f834736-e836-49d3-b931-83ad82bef8f3 could not be found. Apr 12 10:44:28 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:44:28 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e82e10ad-6d7a-4e44-abfb-dfe62c14957b tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Returning 404 to user: Instance 7f834736-e836-49d3-b931-83ad82bef8f3 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:44:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-e82e10ad-6d7a-4e44-abfb-dfe62c14957b tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f834736-e836-49d3-b931-83ad82bef8f3" status: 404 len: 111 microversion: 2.1 time: 0.035521 Apr 12 10:44:28 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 168/515] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:44:28 2023] GET /compute/v2.1/servers/7f834736-e836-49d3-b931-83ad82bef8f3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:44:31 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-c4c85074-baa0-4b8c-8290-24987759e474 req-4994e0c4-d548-4da8-9006-3b1cd8c9e10f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-plugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:31 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=3 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:44:31 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=31 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:44:31 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-c4c85074-baa0-4b8c-8290-24987759e474 req-4994e0c4-d548-4da8-9006-3b1cd8c9e10f service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:31 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-c4c85074-baa0-4b8c-8290-24987759e474 req-4994e0c4-d548-4da8-9006-3b1cd8c9e10f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:31 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-c4c85074-baa0-4b8c-8290-24987759e474 req-4994e0c4-d548-4da8-9006-3b1cd8c9e10f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:31 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:44:31 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-c4c85074-baa0-4b8c-8290-24987759e474 req-4994e0c4-d548-4da8-9006-3b1cd8c9e10f service nova] Creating event network-vif-plugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:44:31 user devstack@n-api.service[61852]: DEBUG nova.compute.api [req-c4c85074-baa0-4b8c-8290-24987759e474 req-4994e0c4-d548-4da8-9006-3b1cd8c9e10f service nova] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61852) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 10:44:31 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-c4c85074-baa0-4b8c-8290-24987759e474 req-4994e0c4-d548-4da8-9006-3b1cd8c9e10f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069204 Apr 12 10:44:31 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 172/516] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:44:33 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-3968ac24-fb34-42db-a3a3-f2c50ee157c0 req-627c58cc-0c6e-4b1e-b3ba-bdd6fb872932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-plugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:33 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:44:33 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:44:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3968ac24-fb34-42db-a3a3-f2c50ee157c0 req-627c58cc-0c6e-4b1e-b3ba-bdd6fb872932 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3968ac24-fb34-42db-a3a3-f2c50ee157c0 req-627c58cc-0c6e-4b1e-b3ba-bdd6fb872932 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3968ac24-fb34-42db-a3a3-f2c50ee157c0 req-627c58cc-0c6e-4b1e-b3ba-bdd6fb872932 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:33 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-3968ac24-fb34-42db-a3a3-f2c50ee157c0 req-627c58cc-0c6e-4b1e-b3ba-bdd6fb872932 service nova] Creating event network-vif-plugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:44:33 user devstack@n-api.service[61854]: DEBUG nova.compute.api [req-3968ac24-fb34-42db-a3a3-f2c50ee157c0 req-627c58cc-0c6e-4b1e-b3ba-bdd6fb872932 service nova] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61854) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 10:44:33 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-3968ac24-fb34-42db-a3a3-f2c50ee157c0 req-627c58cc-0c6e-4b1e-b3ba-bdd6fb872932 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052693 Apr 12 10:44:33 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 177/517] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:37 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-80578300-b7bc-4fe0-b513-e3519b1ba7a5 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:37 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-80578300-b7bc-4fe0-b513-e3519b1ba7a5 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-80578300-b7bc-4fe0-b513-e3519b1ba7a5 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-80578300-b7bc-4fe0-b513-e3519b1ba7a5 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-80578300-b7bc-4fe0-b513-e3519b1ba7a5 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-80578300-b7bc-4fe0-b513-e3519b1ba7a5 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-80578300-b7bc-4fe0-b513-e3519b1ba7a5 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-80578300-b7bc-4fe0-b513-e3519b1ba7a5 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-80578300-b7bc-4fe0-b513-e3519b1ba7a5 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.108259 Apr 12 10:44:37 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 169/518] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 10:44:37 2023] GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683/os-interface => generated 282 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:38 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-7084632f-839e-494e-9f0f-ca5ae7b3972d req-313f5a1a-7861-4533-a202-84fbc9aa85fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b79f4d7-f34e-4971-8a6f-171c2d71d683", "tag": "ac9512bb-5122-4a70-b970-f82605ed0606"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-7084632f-839e-494e-9f0f-ca5ae7b3972d req-313f5a1a-7861-4533-a202-84fbc9aa85fe service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-7084632f-839e-494e-9f0f-ca5ae7b3972d req-313f5a1a-7861-4533-a202-84fbc9aa85fe service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-7084632f-839e-494e-9f0f-ca5ae7b3972d req-313f5a1a-7861-4533-a202-84fbc9aa85fe service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:38 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-7084632f-839e-494e-9f0f-ca5ae7b3972d req-313f5a1a-7861-4533-a202-84fbc9aa85fe service nova] Creating event network-changed:ac9512bb-5122-4a70-b970-f82605ed0606 for instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 on user Apr 12 10:44:38 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-7084632f-839e-494e-9f0f-ca5ae7b3972d req-313f5a1a-7861-4533-a202-84fbc9aa85fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030474 Apr 12 10:44:38 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 173/519] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f5e74a19-6a48-4ac0-b410-a217b26e48e5 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:38 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f5e74a19-6a48-4ac0-b410-a217b26e48e5 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f5e74a19-6a48-4ac0-b410-a217b26e48e5 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f5e74a19-6a48-4ac0-b410-a217b26e48e5 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f5e74a19-6a48-4ac0-b410-a217b26e48e5 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f5e74a19-6a48-4ac0-b410-a217b26e48e5 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f5e74a19-6a48-4ac0-b410-a217b26e48e5 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f5e74a19-6a48-4ac0-b410-a217b26e48e5 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f5e74a19-6a48-4ac0-b410-a217b26e48e5 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683/ips" status: 200 len: 107 microversion: 2.1 time: 0.035639 Apr 12 10:44:38 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 178/520] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 10:44:38 2023] GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683/ips => generated 107 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "520ed03a-e80e-4bc4-afed-57601fa90711"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:40 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302651 Apr 12 10:44:40 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 170/521] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:44:39 2023] POST /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:42 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:42 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:42 user devstack@n-api.service[61852]: DEBUG nova.objects.instance [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'flavor' on Instance uuid 97bafe22-36bf-4939-baf8-9602551bad52 {{(pid=61852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:44:42 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "POST /compute/v2.1/servers/97bafe22-36bf-4939-baf8-9602551bad52/action" status: 200 len: 32 microversion: 2.1 time: 0.175085 Apr 12 10:44:42 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 174/522] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:44:42 2023] POST /compute/v2.1/servers/97bafe22-36bf-4939-baf8-9602551bad52/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 10:44:42 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b90fa1a6-e549-498d-b9ab-1d4cdf1128fc tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:42 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-b90fa1a6-e549-498d-b9ab-1d4cdf1128fc tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b90fa1a6-e549-498d-b9ab-1d4cdf1128fc tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b90fa1a6-e549-498d-b9ab-1d4cdf1128fc tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b90fa1a6-e549-498d-b9ab-1d4cdf1128fc tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b90fa1a6-e549-498d-b9ab-1d4cdf1128fc tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b90fa1a6-e549-498d-b9ab-1d4cdf1128fc tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b90fa1a6-e549-498d-b9ab-1d4cdf1128fc tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:42 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-b90fa1a6-e549-498d-b9ab-1d4cdf1128fc tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:44:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b90fa1a6-e549-498d-b9ab-1d4cdf1128fc tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97bafe22-36bf-4939-baf8-9602551bad52" status: 200 len: 1509 microversion: 2.1 time: 0.163948 Apr 12 10:44:42 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 179/523] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:44:42 2023] GET /compute/v2.1/servers/97bafe22-36bf-4939-baf8-9602551bad52 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:44:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-90893e8f-eaa7-44cf-baa9-f0c8f11a8252 req-56ce45cc-c6ef-41b3-a435-e6e1fef356c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97bafe22-36bf-4939-baf8-9602551bad52", "name": "network-vif-unplugged", "status": "completed", "tag": "580ed46e-ff10-494f-b864-42eda726a7ff"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-90893e8f-eaa7-44cf-baa9-f0c8f11a8252 req-56ce45cc-c6ef-41b3-a435-e6e1fef356c8 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-90893e8f-eaa7-44cf-baa9-f0c8f11a8252 req-56ce45cc-c6ef-41b3-a435-e6e1fef356c8 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-90893e8f-eaa7-44cf-baa9-f0c8f11a8252 req-56ce45cc-c6ef-41b3-a435-e6e1fef356c8 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-90893e8f-eaa7-44cf-baa9-f0c8f11a8252 req-56ce45cc-c6ef-41b3-a435-e6e1fef356c8 service nova] Creating event network-vif-unplugged:580ed46e-ff10-494f-b864-42eda726a7ff for instance 97bafe22-36bf-4939-baf8-9602551bad52 on user Apr 12 10:44:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-90893e8f-eaa7-44cf-baa9-f0c8f11a8252 req-56ce45cc-c6ef-41b3-a435-e6e1fef356c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034101 Apr 12 10:44:43 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 171/524] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:44:45 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-7ea9fc9f-450a-4e70-b5a5-1473d90e990c req-d39ac2e7-c1f6-4deb-a924-f87c7753a04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97bafe22-36bf-4939-baf8-9602551bad52", "name": "network-vif-plugged", "status": "completed", "tag": "580ed46e-ff10-494f-b864-42eda726a7ff"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:45 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-7ea9fc9f-450a-4e70-b5a5-1473d90e990c req-d39ac2e7-c1f6-4deb-a924-f87c7753a04e service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:45 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-7ea9fc9f-450a-4e70-b5a5-1473d90e990c req-d39ac2e7-c1f6-4deb-a924-f87c7753a04e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:45 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-7ea9fc9f-450a-4e70-b5a5-1473d90e990c req-d39ac2e7-c1f6-4deb-a924-f87c7753a04e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:45 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-7ea9fc9f-450a-4e70-b5a5-1473d90e990c req-d39ac2e7-c1f6-4deb-a924-f87c7753a04e service nova] Creating event network-vif-plugged:580ed46e-ff10-494f-b864-42eda726a7ff for instance 97bafe22-36bf-4939-baf8-9602551bad52 on user Apr 12 10:44:45 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-7ea9fc9f-450a-4e70-b5a5-1473d90e990c req-d39ac2e7-c1f6-4deb-a924-f87c7753a04e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035498 Apr 12 10:44:45 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 175/525] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:46 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2135b5b0-ad64-46e2-8739-72a966ae5714 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:46 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-2135b5b0-ad64-46e2-8739-72a966ae5714 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2135b5b0-ad64-46e2-8739-72a966ae5714 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2135b5b0-ad64-46e2-8739-72a966ae5714 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2135b5b0-ad64-46e2-8739-72a966ae5714 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2135b5b0-ad64-46e2-8739-72a966ae5714 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2135b5b0-ad64-46e2-8739-72a966ae5714 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2135b5b0-ad64-46e2-8739-72a966ae5714 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:46 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-2135b5b0-ad64-46e2-8739-72a966ae5714 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:44:46 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-2135b5b0-ad64-46e2-8739-72a966ae5714 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:44:46 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-2135b5b0-ad64-46e2-8739-72a966ae5714 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:44:46 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2135b5b0-ad64-46e2-8739-72a966ae5714 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" status: 200 len: 1690 microversion: 2.87 time: 0.194818 Apr 12 10:44:46 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 180/526] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:44:46 2023] GET /compute/v2.1/servers/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 => generated 1690 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:44:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97bafe22-36bf-4939-baf8-9602551bad52", "name": "network-vif-plugged", "status": "completed", "tag": "580ed46e-ff10-494f-b864-42eda726a7ff"}, {"server_uuid": "97bafe22-36bf-4939-baf8-9602551bad52", "name": "network-vif-plugged", "status": "completed", "tag": "580ed46e-ff10-494f-b864-42eda726a7ff"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] Creating event network-vif-plugged:580ed46e-ff10-494f-b864-42eda726a7ff for instance 97bafe22-36bf-4939-baf8-9602551bad52 on user Apr 12 10:44:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] Creating event network-vif-plugged:580ed46e-ff10-494f-b864-42eda726a7ff for instance 97bafe22-36bf-4939-baf8-9602551bad52 on user Apr 12 10:44:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044679 Apr 12 10:44:47 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 172/527] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:47 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:47 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-dda43a8c-0b06-4ba5-b65b-28b8b481aff9 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Action: 'create', calling method: .version_select at 0x7fabbf7ee7a0>, body: {"keypair": {"name": "tempest-keypair-615324409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVmlusjBbAhyfKjhgK8Wa0Pp75RNtE1Qsp17vW0I9s4GPmFdzLWN9G7QfMJm6jzPTGesB4vogBF69JOIb6I1a2Sp2CezrTO671jnBpw/4t36Yvu2usg+rqCY+LYMh5Aig=="}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:47 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-dda43a8c-0b06-4ba5-b65b-28b8b481aff9 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting quotas for project c3cecbfbfd5f42dbb663367f6fbdf3b0. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:44:47 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-dda43a8c-0b06-4ba5-b65b-28b8b481aff9 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting quotas for user 7ec47d3cdacb45e5a39509e76b546e34 and project c3cecbfbfd5f42dbb663367f6fbdf3b0. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:44:47 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-dda43a8c-0b06-4ba5-b65b-28b8b481aff9 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048122 Apr 12 10:44:47 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 176/528] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 10:44:47 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:49 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1530539013", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0"}], "security_groups": [{"name": "tempest-securitygroup--1526965708"}], "key_name": "tempest-keypair-615324409", "user_data": "}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:49 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] validate_networks() for [('ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:44:50 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:44:50 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:44:50 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:44:50 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:44:50 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:44:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:50 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting quotas for project c3cecbfbfd5f42dbb663367f6fbdf3b0. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:44:50 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting quotas for user 7ec47d3cdacb45e5a39509e76b546e34 and project c3cecbfbfd5f42dbb663367f6fbdf3b0. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:44:50 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:44:50 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:44:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.575905 Apr 12 10:44:50 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 181/529] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:44:49 2023] POST /compute/v2.1/servers => generated 400 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:44:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-72218988-60c9-4c66-975e-85d382e6ada9 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:50 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-72218988-60c9-4c66-975e-85d382e6ada9 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:50 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-72218988-60c9-4c66-975e-85d382e6ada9 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec47d3cdacb45e5a39509e76b546e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cecbfbfd5f42dbb663367f6fbdf3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:44:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-72218988-60c9-4c66-975e-85d382e6ada9 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44" status: 200 len: 1235 microversion: 2.1 time: 0.101983 Apr 12 10:44:50 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 173/530] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:44:50 2023] GET /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44 => generated 1235 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:44:53 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-489c3f25-8eab-400a-bd22-a84c6335b29b req-f6c4c50a-f98a-4135-b961-3aa9900d6d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979fbc15-1dd0-46b8-a9c4-54be9d93da44", "tag": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-489c3f25-8eab-400a-bd22-a84c6335b29b req-f6c4c50a-f98a-4135-b961-3aa9900d6d64 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-489c3f25-8eab-400a-bd22-a84c6335b29b req-f6c4c50a-f98a-4135-b961-3aa9900d6d64 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-489c3f25-8eab-400a-bd22-a84c6335b29b req-f6c4c50a-f98a-4135-b961-3aa9900d6d64 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:53 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-489c3f25-8eab-400a-bd22-a84c6335b29b req-f6c4c50a-f98a-4135-b961-3aa9900d6d64 service nova] Creating event network-changed:84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 for instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 on user Apr 12 10:44:53 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-489c3f25-8eab-400a-bd22-a84c6335b29b req-f6c4c50a-f98a-4135-b961-3aa9900d6d64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032426 Apr 12 10:44:53 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 177/531] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:55 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-7e1d6b1e-c498-481b-944a-b274ad75ab29 req-44a65836-dee6-4022-b2bd-e5581c36089c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979fbc15-1dd0-46b8-a9c4-54be9d93da44", "name": "network-vif-plugged", "status": "completed", "tag": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7e1d6b1e-c498-481b-944a-b274ad75ab29 req-44a65836-dee6-4022-b2bd-e5581c36089c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7e1d6b1e-c498-481b-944a-b274ad75ab29 req-44a65836-dee6-4022-b2bd-e5581c36089c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7e1d6b1e-c498-481b-944a-b274ad75ab29 req-44a65836-dee6-4022-b2bd-e5581c36089c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:55 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-7e1d6b1e-c498-481b-944a-b274ad75ab29 req-44a65836-dee6-4022-b2bd-e5581c36089c service nova] Creating event network-vif-plugged:84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 for instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 on user Apr 12 10:44:55 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-7e1d6b1e-c498-481b-944a-b274ad75ab29 req-44a65836-dee6-4022-b2bd-e5581c36089c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038448 Apr 12 10:44:55 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 182/532] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:44:55 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-950c2f76-ff91-4ba7-b511-39df4ae8e5e3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:44:55 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-950c2f76-ff91-4ba7-b511-39df4ae8e5e3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:44:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-950c2f76-ff91-4ba7-b511-39df4ae8e5e3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-950c2f76-ff91-4ba7-b511-39df4ae8e5e3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-950c2f76-ff91-4ba7-b511-39df4ae8e5e3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-950c2f76-ff91-4ba7-b511-39df4ae8e5e3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-950c2f76-ff91-4ba7-b511-39df4ae8e5e3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:55 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-950c2f76-ff91-4ba7-b511-39df4ae8e5e3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:55 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-950c2f76-ff91-4ba7-b511-39df4ae8e5e3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccad0e37147441cb68130a22197a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bb70c871154a14947ea3421553a229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:44:55 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-950c2f76-ff91-4ba7-b511-39df4ae8e5e3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6468f2a7-ce19-468d-8b8f-e6071cf437ff" status: 200 len: 1485 microversion: 2.1 time: 0.216301 Apr 12 10:44:55 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 174/533] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:44:55 2023] GET /compute/v2.1/servers/6468f2a7-ce19-468d-8b8f-e6071cf437ff => generated 1485 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:44:57 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-504499fa-c826-44b2-888d-646550f0051e req-8847f4da-bee9-4ed5-b224-2b51b0e6915f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979fbc15-1dd0-46b8-a9c4-54be9d93da44", "name": "network-vif-plugged", "status": "completed", "tag": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:44:57 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-504499fa-c826-44b2-888d-646550f0051e req-8847f4da-bee9-4ed5-b224-2b51b0e6915f service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:44:57 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-504499fa-c826-44b2-888d-646550f0051e req-8847f4da-bee9-4ed5-b224-2b51b0e6915f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:44:57 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-504499fa-c826-44b2-888d-646550f0051e req-8847f4da-bee9-4ed5-b224-2b51b0e6915f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:44:57 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-504499fa-c826-44b2-888d-646550f0051e req-8847f4da-bee9-4ed5-b224-2b51b0e6915f service nova] Creating event network-vif-plugged:84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 for instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 on user Apr 12 10:44:57 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-504499fa-c826-44b2-888d-646550f0051e req-8847f4da-bee9-4ed5-b224-2b51b0e6915f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032904 Apr 12 10:44:57 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 178/534] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:44:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:45:04 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:04 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:04 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3241da4b-93e0-4deb-8f6b-b8a42d22ddb2 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:45:04 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-3241da4b-93e0-4deb-8f6b-b8a42d22ddb2 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:45:04 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3241da4b-93e0-4deb-8f6b-b8a42d22ddb2 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3241da4b-93e0-4deb-8f6b-b8a42d22ddb2 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3241da4b-93e0-4deb-8f6b-b8a42d22ddb2 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3241da4b-93e0-4deb-8f6b-b8a42d22ddb2 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3241da4b-93e0-4deb-8f6b-b8a42d22ddb2 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3241da4b-93e0-4deb-8f6b-b8a42d22ddb2 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:04 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=25 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-3241da4b-93e0-4deb-8f6b-b8a42d22ddb2 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] HTTP exception thrown: Instance dc6eb5d4-d415-4459-a95b-5a470ec66586 could not be found. Apr 12 10:45:04 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3241da4b-93e0-4deb-8f6b-b8a42d22ddb2 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Request method failure captured: Apr 12 10:45:04 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586 HTTP/1.1 Apr 12 10:45:04 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:45:04 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:45:04 user devstack@n-api.service[61854]: Connection: close Apr 12 10:45:04 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:45:04 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:45:04 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:45:04 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:45:04 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:45:04 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNolyPj4uP3fUaGvJghQbYB0eJurMk0aTXOP8m_SRC4HCE3RKd0kG4NblpxL-3HoVpVY4fHbUBjkQR9sFtLPZCwY79AY01f-FnXJli2U-y_sg0L5mYp62dEOpZN86j2hPkA0DEz8im88zu7QIITcqH4-51-4fU1cE5F0swgyw4tBPWWI Apr 12 10:45:04 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:45:04 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:45:04 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:45:04 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:45:04 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:45:04 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:45:04 user devstack@n-api.service[61854]: X-Project-Id: 024682bfda5548b8b9b404c85dd55b34 Apr 12 10:45:04 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServersNegativeTestJSON-563292074 Apr 12 10:45:04 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:45:04 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:45:04 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/024682bfda5548b8b9b404c85dd55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/024682bfda5548b8b9b404c85dd55b34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/024682bfda5548b8b9b404c85dd55b34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:45:04 user devstack@n-api.service[61854]: X-Tenant: tempest-ServersNegativeTestJSON-563292074 Apr 12 10:45:04 user devstack@n-api.service[61854]: X-Tenant-Id: 024682bfda5548b8b9b404c85dd55b34 Apr 12 10:45:04 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServersNegativeTestJSON-563292074 Apr 12 10:45:04 user devstack@n-api.service[61854]: X-User: tempest-ServersNegativeTestJSON-563292074-project-member Apr 12 10:45:04 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:45:04 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:45:04 user devstack@n-api.service[61854]: X-User-Id: 33d19bfc4894401cb664521438338b9a Apr 12 10:45:04 user devstack@n-api.service[61854]: X-User-Name: tempest-ServersNegativeTestJSON-563292074-project-member Apr 12 10:45:04 user devstack@n-api.service[61854]: method: > Apr 12 10:45:04 user devstack@n-api.service[61854]: exception: Instance dc6eb5d4-d415-4459-a95b-5a470ec66586 could not be found. Apr 12 10:45:04 user devstack@n-api.service[61854]: action_args: {'id': 'dc6eb5d4-d415-4459-a95b-5a470ec66586'} Apr 12 10:45:04 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6eb5d4-d415-4459-a95b-5a470ec66586 could not be found. Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6eb5d4-d415-4459-a95b-5a470ec66586 could not be found. Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6eb5d4-d415-4459-a95b-5a470ec66586 could not be found. Apr 12 10:45:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:45:04 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3241da4b-93e0-4deb-8f6b-b8a42d22ddb2 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Returning 404 to user: Instance dc6eb5d4-d415-4459-a95b-5a470ec66586 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:45:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-3241da4b-93e0-4deb-8f6b-b8a42d22ddb2 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586" status: 404 len: 111 microversion: 2.1 time: 0.038610 Apr 12 10:45:04 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 183/535] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:45:04 2023] GET /compute/v2.1/servers/dc6eb5d4-d415-4459-a95b-5a470ec66586 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:45:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-307489b7-de53-4ace-9cc7-426dd3b9540c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:45:07 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-307489b7-de53-4ace-9cc7-426dd3b9540c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:45:07 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:07 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=15 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:07 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-307489b7-de53-4ace-9cc7-426dd3b9540c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-307489b7-de53-4ace-9cc7-426dd3b9540c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-307489b7-de53-4ace-9cc7-426dd3b9540c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-307489b7-de53-4ace-9cc7-426dd3b9540c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-307489b7-de53-4ace-9cc7-426dd3b9540c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-307489b7-de53-4ace-9cc7-426dd3b9540c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:08 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-307489b7-de53-4ace-9cc7-426dd3b9540c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:45:08 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-307489b7-de53-4ace-9cc7-426dd3b9540c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1731 microversion: 2.1 time: 0.728328 Apr 12 10:45:08 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 175/536] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:45:07 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1731 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:45:08 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:08 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:08 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:08 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-334de004-1334-4090-bbcd-1dd27c6839db tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:45:08 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-334de004-1334-4090-bbcd-1dd27c6839db tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:45:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-334de004-1334-4090-bbcd-1dd27c6839db tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-334de004-1334-4090-bbcd-1dd27c6839db tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-334de004-1334-4090-bbcd-1dd27c6839db tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-334de004-1334-4090-bbcd-1dd27c6839db tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-334de004-1334-4090-bbcd-1dd27c6839db tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-334de004-1334-4090-bbcd-1dd27c6839db tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:09 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-334de004-1334-4090-bbcd-1dd27c6839db tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.069537 Apr 12 10:45:09 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 179/537] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 10:45:08 2023] GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:45:09 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:45:09 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:45:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:09 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:45:09 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa" status: 204 len: 0 microversion: 2.20 time: 0.189672 Apr 12 10:45:09 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 184/538] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 10:45:09 2023] DELETE /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 10:45:09 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1ac68fa4-05ca-4917-8efc-8bd125ead455 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:45:09 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-1ac68fa4-05ca-4917-8efc-8bd125ead455 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:45:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ac68fa4-05ca-4917-8efc-8bd125ead455 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ac68fa4-05ca-4917-8efc-8bd125ead455 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ac68fa4-05ca-4917-8efc-8bd125ead455 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ac68fa4-05ca-4917-8efc-8bd125ead455 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ac68fa4-05ca-4917-8efc-8bd125ead455 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ac68fa4-05ca-4917-8efc-8bd125ead455 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:09 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-1ac68fa4-05ca-4917-8efc-8bd125ead455 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:45:09 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-1ac68fa4-05ca-4917-8efc-8bd125ead455 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:45:09 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-1ac68fa4-05ca-4917-8efc-8bd125ead455 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:45:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1ac68fa4-05ca-4917-8efc-8bd125ead455 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa" status: 200 len: 1711 microversion: 2.20 time: 0.496533 Apr 12 10:45:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 176/539] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:45:09 2023] GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa => generated 1711 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:45:10 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-9a20deec-6cdc-4eb3-9db1-d0909d0476fe req-73a36f53-6996-4ae9-88c2-b134ab592e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bfafa79-ce40-42f1-9992-10e50734f7fa", "name": "network-vif-unplugged", "status": "completed", "tag": "4de5a799-c343-4e41-88ef-ebaaa3adb14c"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:45:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-9a20deec-6cdc-4eb3-9db1-d0909d0476fe req-73a36f53-6996-4ae9-88c2-b134ab592e44 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-9a20deec-6cdc-4eb3-9db1-d0909d0476fe req-73a36f53-6996-4ae9-88c2-b134ab592e44 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-9a20deec-6cdc-4eb3-9db1-d0909d0476fe req-73a36f53-6996-4ae9-88c2-b134ab592e44 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:10 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-9a20deec-6cdc-4eb3-9db1-d0909d0476fe req-73a36f53-6996-4ae9-88c2-b134ab592e44 service nova] Creating event network-vif-unplugged:4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance 0bfafa79-ce40-42f1-9992-10e50734f7fa on user Apr 12 10:45:10 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-9a20deec-6cdc-4eb3-9db1-d0909d0476fe req-73a36f53-6996-4ae9-88c2-b134ab592e44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028867 Apr 12 10:45:10 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 180/540] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:45:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:45:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-f4477d62-87f4-4c6c-a947-8432a3ca77ed req-ca2e69fd-ba58-4dbf-b937-e49bd34f66b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bfafa79-ce40-42f1-9992-10e50734f7fa", "name": "network-vif-deleted", "tag": "4de5a799-c343-4e41-88ef-ebaaa3adb14c"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:45:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f4477d62-87f4-4c6c-a947-8432a3ca77ed req-ca2e69fd-ba58-4dbf-b937-e49bd34f66b2 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f4477d62-87f4-4c6c-a947-8432a3ca77ed req-ca2e69fd-ba58-4dbf-b937-e49bd34f66b2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f4477d62-87f4-4c6c-a947-8432a3ca77ed req-ca2e69fd-ba58-4dbf-b937-e49bd34f66b2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f4477d62-87f4-4c6c-a947-8432a3ca77ed req-ca2e69fd-ba58-4dbf-b937-e49bd34f66b2 service nova] Creating event network-vif-deleted:4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance 0bfafa79-ce40-42f1-9992-10e50734f7fa on user Apr 12 10:45:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-f4477d62-87f4-4c6c-a947-8432a3ca77ed req-ca2e69fd-ba58-4dbf-b937-e49bd34f66b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032046 Apr 12 10:45:11 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 185/541] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:45:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:45:12 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-bc79ab05-3e29-4fbf-9267-34cbdd91c97a req-fb8f3a9d-53ac-424c-8837-e8e952cfb985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bfafa79-ce40-42f1-9992-10e50734f7fa", "name": "network-vif-plugged", "status": "completed", "tag": "4de5a799-c343-4e41-88ef-ebaaa3adb14c"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:45:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-bc79ab05-3e29-4fbf-9267-34cbdd91c97a req-fb8f3a9d-53ac-424c-8837-e8e952cfb985 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-bc79ab05-3e29-4fbf-9267-34cbdd91c97a req-fb8f3a9d-53ac-424c-8837-e8e952cfb985 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-bc79ab05-3e29-4fbf-9267-34cbdd91c97a req-fb8f3a9d-53ac-424c-8837-e8e952cfb985 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:12 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-bc79ab05-3e29-4fbf-9267-34cbdd91c97a req-fb8f3a9d-53ac-424c-8837-e8e952cfb985 service nova] Creating event network-vif-plugged:4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance 0bfafa79-ce40-42f1-9992-10e50734f7fa on user Apr 12 10:45:12 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-bc79ab05-3e29-4fbf-9267-34cbdd91c97a req-fb8f3a9d-53ac-424c-8837-e8e952cfb985 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031421 Apr 12 10:45:12 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 177/542] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:45:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:45:15 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-af6eb3db-f67c-43f9-b167-e3d99d57fa89 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Action: 'create', calling method: .version_select at 0x7fabbf6d48b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2015119923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2R09lY3z1ofkLd/mex8UHM7qHU7uJkgT1OJi5eN5mVbcu+cTMWeldTRYda5cvD2AEA6DLVvL+HztqfG6Bz3W8LigkJXzJuoHTW2uKsH+Ju0S6/fUn1Cb36RGt8Yf4qPQ=="}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:45:15 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-af6eb3db-f67c-43f9-b167-e3d99d57fa89 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Getting quotas for project b467fac451ee466fb93cec3d3aa3b408. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:45:15 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-af6eb3db-f67c-43f9-b167-e3d99d57fa89 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Getting quotas for user a633ec4046a9467683cbfd2ebe59600f and project b467fac451ee466fb93cec3d3aa3b408. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:45:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-af6eb3db-f67c-43f9-b167-e3d99d57fa89 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.046056 Apr 12 10:45:15 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 181/543] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 10:45:15 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:45:15 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-158631664", "imageRef": "5bdef35f-97c6-4c63-9b32-a181693bd012", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-2015119923", "networks": [{"uuid": "d284a588-7406-446d-af3c-874a119b7536"}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:45:15 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] validate_networks() for [('d284a588-7406-446d-af3c-874a119b7536', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:45:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:45:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:45:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:45:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:45:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:45:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:16 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Getting quotas for project b467fac451ee466fb93cec3d3aa3b408. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:45:16 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Getting quotas for user a633ec4046a9467683cbfd2ebe59600f and project b467fac451ee466fb93cec3d3aa3b408. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:45:16 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:45:16 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5bdef35f-97c6-4c63-9b32-a181693bd012',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:45:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.615007 Apr 12 10:45:16 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 186/544] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:45:15 2023] POST /compute/v2.1/servers => generated 378 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:45:16 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-62cd6118-3052-497e-9d76-798b28b1d3a7 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:45:16 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-62cd6118-3052-497e-9d76-798b28b1d3a7 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:45:16 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-62cd6118-3052-497e-9d76-798b28b1d3a7 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:45:16 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-62cd6118-3052-497e-9d76-798b28b1d3a7 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3" status: 200 len: 1252 microversion: 2.1 time: 0.187778 Apr 12 10:45:16 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 178/545] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:45:16 2023] GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3 => generated 1252 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:45:19 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-d25365cb-551c-4887-9978-d7cc2c7c248c req-2e3f0daa-1680-4551-815a-fd05bb1a801d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d687131b-6853-4d65-b8f7-ecef019ae9f3", "tag": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:45:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d25365cb-551c-4887-9978-d7cc2c7c248c req-2e3f0daa-1680-4551-815a-fd05bb1a801d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d25365cb-551c-4887-9978-d7cc2c7c248c req-2e3f0daa-1680-4551-815a-fd05bb1a801d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d25365cb-551c-4887-9978-d7cc2c7c248c req-2e3f0daa-1680-4551-815a-fd05bb1a801d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:19 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-d25365cb-551c-4887-9978-d7cc2c7c248c req-2e3f0daa-1680-4551-815a-fd05bb1a801d service nova] Creating event network-changed:04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance d687131b-6853-4d65-b8f7-ecef019ae9f3 on user Apr 12 10:45:19 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-d25365cb-551c-4887-9978-d7cc2c7c248c req-2e3f0daa-1680-4551-815a-fd05bb1a801d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038006 Apr 12 10:45:19 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 182/546] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:45:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:45:21 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-291f0f83-1979-47a6-859c-0a29e8d0ab78 req-f6d48833-1a5b-4c72-b6af-5fa57bbd236b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d687131b-6853-4d65-b8f7-ecef019ae9f3", "name": "network-vif-plugged", "status": "completed", "tag": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:45:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-291f0f83-1979-47a6-859c-0a29e8d0ab78 req-f6d48833-1a5b-4c72-b6af-5fa57bbd236b service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-291f0f83-1979-47a6-859c-0a29e8d0ab78 req-f6d48833-1a5b-4c72-b6af-5fa57bbd236b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-291f0f83-1979-47a6-859c-0a29e8d0ab78 req-f6d48833-1a5b-4c72-b6af-5fa57bbd236b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-291f0f83-1979-47a6-859c-0a29e8d0ab78 req-f6d48833-1a5b-4c72-b6af-5fa57bbd236b service nova] Creating event network-vif-plugged:04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance d687131b-6853-4d65-b8f7-ecef019ae9f3 on user Apr 12 10:45:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-291f0f83-1979-47a6-859c-0a29e8d0ab78 req-f6d48833-1a5b-4c72-b6af-5fa57bbd236b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038260 Apr 12 10:45:21 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 187/547] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:45:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:45:23 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:45:23 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:45:23 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=14 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:23 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61853) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 10:45:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] 10.0.0.210 "POST /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e/action" status: 202 len: 0 microversion: 2.1 time: 0.147025 Apr 12 10:45:23 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 179/548] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:45:23 2023] POST /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:45:23 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-c2790428-93a8-49d3-a88c-af13fc2189aa tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:45:23 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-c2790428-93a8-49d3-a88c-af13fc2189aa tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:45:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c2790428-93a8-49d3-a88c-af13fc2189aa tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c2790428-93a8-49d3-a88c-af13fc2189aa tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c2790428-93a8-49d3-a88c-af13fc2189aa tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c2790428-93a8-49d3-a88c-af13fc2189aa tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c2790428-93a8-49d3-a88c-af13fc2189aa tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c2790428-93a8-49d3-a88c-af13fc2189aa tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:23 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-f599431a-5332-4802-8438-6bd6fb4294fb req-b5a7bed2-13cd-4f99-81eb-3968d1027437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d687131b-6853-4d65-b8f7-ecef019ae9f3", "name": "network-vif-plugged", "status": "completed", "tag": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:45:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f599431a-5332-4802-8438-6bd6fb4294fb req-b5a7bed2-13cd-4f99-81eb-3968d1027437 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f599431a-5332-4802-8438-6bd6fb4294fb req-b5a7bed2-13cd-4f99-81eb-3968d1027437 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f599431a-5332-4802-8438-6bd6fb4294fb req-b5a7bed2-13cd-4f99-81eb-3968d1027437 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f599431a-5332-4802-8438-6bd6fb4294fb req-b5a7bed2-13cd-4f99-81eb-3968d1027437 service nova] Creating event network-vif-plugged:04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance d687131b-6853-4d65-b8f7-ecef019ae9f3 on user Apr 12 10:45:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-f599431a-5332-4802-8438-6bd6fb4294fb req-b5a7bed2-13cd-4f99-81eb-3968d1027437 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042414 Apr 12 10:45:23 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 188/549] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:45:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:45:23 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-c2790428-93a8-49d3-a88c-af13fc2189aa tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574af27cae41457c9be3d5d50d347b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef7aa45de34b01a97b6bc5e0acece5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:45:23 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-c2790428-93a8-49d3-a88c-af13fc2189aa tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e" status: 200 len: 1505 microversion: 2.1 time: 0.421168 Apr 12 10:45:23 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 183/550] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:45:23 2023] GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e => generated 1505 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:45:30 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-f85aaa38-1ab9-4dcb-b5d6-d22e459eba1a req-0780838b-60f1-4ad5-982f-57c2ea9fb0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b29390-867e-4bf3-bc93-b401f32b130e", "tag": "78a8426a-653a-44cb-80b7-8a8b14d78cf4"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:45:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f85aaa38-1ab9-4dcb-b5d6-d22e459eba1a req-0780838b-60f1-4ad5-982f-57c2ea9fb0f9 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f85aaa38-1ab9-4dcb-b5d6-d22e459eba1a req-0780838b-60f1-4ad5-982f-57c2ea9fb0f9 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f85aaa38-1ab9-4dcb-b5d6-d22e459eba1a req-0780838b-60f1-4ad5-982f-57c2ea9fb0f9 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-f85aaa38-1ab9-4dcb-b5d6-d22e459eba1a req-0780838b-60f1-4ad5-982f-57c2ea9fb0f9 service nova] Creating event network-changed:78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance 68b29390-867e-4bf3-bc93-b401f32b130e on user Apr 12 10:45:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-f85aaa38-1ab9-4dcb-b5d6-d22e459eba1a req-0780838b-60f1-4ad5-982f-57c2ea9fb0f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033018 Apr 12 10:45:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 180/551] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:45:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:45:32 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:32 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:32 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-70382369-973f-4e83-aa72-fbca22c9b675 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:45:32 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-70382369-973f-4e83-aa72-fbca22c9b675 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:45:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-70382369-973f-4e83-aa72-fbca22c9b675 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-70382369-973f-4e83-aa72-fbca22c9b675 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-70382369-973f-4e83-aa72-fbca22c9b675 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-70382369-973f-4e83-aa72-fbca22c9b675 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-70382369-973f-4e83-aa72-fbca22c9b675 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-70382369-973f-4e83-aa72-fbca22c9b675 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:33 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-70382369-973f-4e83-aa72-fbca22c9b675 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:45:33 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-70382369-973f-4e83-aa72-fbca22c9b675 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97bafe22-36bf-4939-baf8-9602551bad52" status: 200 len: 1489 microversion: 2.1 time: 0.280760 Apr 12 10:45:33 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 189/552] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:45:32 2023] GET /compute/v2.1/servers/97bafe22-36bf-4939-baf8-9602551bad52 => generated 1489 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:45:34 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:34 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:34 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=16 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:34 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-aa476313-d2a6-414a-b94f-7bc1cb894803 req-4cdd609c-7102-4a59-8d14-757a270d0925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b29390-867e-4bf3-bc93-b401f32b130e", "name": "network-vif-plugged", "status": "completed", "tag": "78a8426a-653a-44cb-80b7-8a8b14d78cf4"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:45:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-aa476313-d2a6-414a-b94f-7bc1cb894803 req-4cdd609c-7102-4a59-8d14-757a270d0925 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-aa476313-d2a6-414a-b94f-7bc1cb894803 req-4cdd609c-7102-4a59-8d14-757a270d0925 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-aa476313-d2a6-414a-b94f-7bc1cb894803 req-4cdd609c-7102-4a59-8d14-757a270d0925 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:34 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-aa476313-d2a6-414a-b94f-7bc1cb894803 req-4cdd609c-7102-4a59-8d14-757a270d0925 service nova] Creating event network-vif-plugged:78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance 68b29390-867e-4bf3-bc93-b401f32b130e on user Apr 12 10:45:34 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-aa476313-d2a6-414a-b94f-7bc1cb894803 req-4cdd609c-7102-4a59-8d14-757a270d0925 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.293498 Apr 12 10:45:34 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 184/553] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:45:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:45:36 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-f7b629aa-44cc-47e1-bb3a-08b4e41e553d req-0a2b75d4-e2dc-48f8-90b9-59156b0755d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b29390-867e-4bf3-bc93-b401f32b130e", "name": "network-vif-plugged", "status": "completed", "tag": "78a8426a-653a-44cb-80b7-8a8b14d78cf4"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:45:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f7b629aa-44cc-47e1-bb3a-08b4e41e553d req-0a2b75d4-e2dc-48f8-90b9-59156b0755d2 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f7b629aa-44cc-47e1-bb3a-08b4e41e553d req-0a2b75d4-e2dc-48f8-90b9-59156b0755d2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f7b629aa-44cc-47e1-bb3a-08b4e41e553d req-0a2b75d4-e2dc-48f8-90b9-59156b0755d2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-f7b629aa-44cc-47e1-bb3a-08b4e41e553d req-0a2b75d4-e2dc-48f8-90b9-59156b0755d2 service nova] Creating event network-vif-plugged:78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance 68b29390-867e-4bf3-bc93-b401f32b130e on user Apr 12 10:45:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-f7b629aa-44cc-47e1-bb3a-08b4e41e553d req-0a2b75d4-e2dc-48f8-90b9-59156b0755d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033106 Apr 12 10:45:36 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 181/554] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:45:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:45:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-eea79b6b-f282-4442-b297-c36710b5ab9a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:45:40 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-eea79b6b-f282-4442-b297-c36710b5ab9a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:45:40 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eea79b6b-f282-4442-b297-c36710b5ab9a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eea79b6b-f282-4442-b297-c36710b5ab9a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eea79b6b-f282-4442-b297-c36710b5ab9a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eea79b6b-f282-4442-b297-c36710b5ab9a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eea79b6b-f282-4442-b297-c36710b5ab9a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-eea79b6b-f282-4442-b297-c36710b5ab9a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:40 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:40 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-eea79b6b-f282-4442-b297-c36710b5ab9a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec47d3cdacb45e5a39509e76b546e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cecbfbfd5f42dbb663367f6fbdf3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:45:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-eea79b6b-f282-4442-b297-c36710b5ab9a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44" status: 200 len: 1544 microversion: 2.1 time: 0.313588 Apr 12 10:45:40 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 190/555] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:45:40 2023] GET /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44 => generated 1544 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:45:46 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:46 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:46 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1538756384"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:45:46 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:45:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:47 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/action" status: 202 len: 52 microversion: 2.87 time: 0.887048 Apr 12 10:45:47 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 185/556] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 10:45:46 2023] POST /compute/v2.1/servers/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/action => generated 52 bytes in 889 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 12 10:45:52 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:52 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5d8ca70c-0e30-4e4b-84a1-7e5bde8983af tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:45:52 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5d8ca70c-0e30-4e4b-84a1-7e5bde8983af tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:45:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5d8ca70c-0e30-4e4b-84a1-7e5bde8983af tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5d8ca70c-0e30-4e4b-84a1-7e5bde8983af tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5d8ca70c-0e30-4e4b-84a1-7e5bde8983af tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5d8ca70c-0e30-4e4b-84a1-7e5bde8983af tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5d8ca70c-0e30-4e4b-84a1-7e5bde8983af tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5d8ca70c-0e30-4e4b-84a1-7e5bde8983af tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:52 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-5d8ca70c-0e30-4e4b-84a1-7e5bde8983af tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:45:52 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-5d8ca70c-0e30-4e4b-84a1-7e5bde8983af tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:45:52 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-5d8ca70c-0e30-4e4b-84a1-7e5bde8983af tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:45:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5d8ca70c-0e30-4e4b-84a1-7e5bde8983af tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" status: 200 len: 1690 microversion: 2.87 time: 0.179777 Apr 12 10:45:52 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 182/557] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:45:52 2023] GET /compute/v2.1/servers/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 => generated 1690 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:45:56 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:45:56 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:45:56 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:56 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=5 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:45:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:56 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:45:56 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6468f2a7-ce19-468d-8b8f-e6071cf437ff" status: 204 len: 0 microversion: 2.1 time: 0.134381 Apr 12 10:45:56 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 191/558] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:45:56 2023] DELETE /compute/v2.1/servers/6468f2a7-ce19-468d-8b8f-e6071cf437ff => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:45:56 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-7a019eb2-a57e-40f3-9051-21805e853c92 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:45:56 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-7a019eb2-a57e-40f3-9051-21805e853c92 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:45:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7a019eb2-a57e-40f3-9051-21805e853c92 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7a019eb2-a57e-40f3-9051-21805e853c92 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7a019eb2-a57e-40f3-9051-21805e853c92 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7a019eb2-a57e-40f3-9051-21805e853c92 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7a019eb2-a57e-40f3-9051-21805e853c92 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7a019eb2-a57e-40f3-9051-21805e853c92 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:56 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-7a019eb2-a57e-40f3-9051-21805e853c92 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccad0e37147441cb68130a22197a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bb70c871154a14947ea3421553a229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:45:56 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-7a019eb2-a57e-40f3-9051-21805e853c92 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6468f2a7-ce19-468d-8b8f-e6071cf437ff" status: 200 len: 1491 microversion: 2.1 time: 0.174538 Apr 12 10:45:56 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 186/559] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:45:56 2023] GET /compute/v2.1/servers/6468f2a7-ce19-468d-8b8f-e6071cf437ff => generated 1491 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:45:56 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-9e4eb256-93cd-4aa2-b77d-30c7d6401346 req-5a853ee8-495d-413a-82cc-11466feaa9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6468f2a7-ce19-468d-8b8f-e6071cf437ff", "name": "network-vif-unplugged", "status": "completed", "tag": "2970d881-0a68-41b7-a58c-1876abba1236"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:45:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9e4eb256-93cd-4aa2-b77d-30c7d6401346 req-5a853ee8-495d-413a-82cc-11466feaa9a1 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9e4eb256-93cd-4aa2-b77d-30c7d6401346 req-5a853ee8-495d-413a-82cc-11466feaa9a1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9e4eb256-93cd-4aa2-b77d-30c7d6401346 req-5a853ee8-495d-413a-82cc-11466feaa9a1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-9e4eb256-93cd-4aa2-b77d-30c7d6401346 req-5a853ee8-495d-413a-82cc-11466feaa9a1 service nova] Creating event network-vif-unplugged:2970d881-0a68-41b7-a58c-1876abba1236 for instance 6468f2a7-ce19-468d-8b8f-e6071cf437ff on user Apr 12 10:45:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-9e4eb256-93cd-4aa2-b77d-30c7d6401346 req-5a853ee8-495d-413a-82cc-11466feaa9a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029119 Apr 12 10:45:56 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 183/560] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:45:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:45:58 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-e0859049-bb20-4beb-be94-9bfef941d4eb req-83f365f3-a503-403e-8430-5cb7303d28d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6468f2a7-ce19-468d-8b8f-e6071cf437ff", "name": "network-vif-deleted", "tag": "2970d881-0a68-41b7-a58c-1876abba1236"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:45:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e0859049-bb20-4beb-be94-9bfef941d4eb req-83f365f3-a503-403e-8430-5cb7303d28d9 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e0859049-bb20-4beb-be94-9bfef941d4eb req-83f365f3-a503-403e-8430-5cb7303d28d9 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-e0859049-bb20-4beb-be94-9bfef941d4eb req-83f365f3-a503-403e-8430-5cb7303d28d9 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:58 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-e0859049-bb20-4beb-be94-9bfef941d4eb req-83f365f3-a503-403e-8430-5cb7303d28d9 service nova] Creating event network-vif-deleted:2970d881-0a68-41b7-a58c-1876abba1236 for instance 6468f2a7-ce19-468d-8b8f-e6071cf437ff on user Apr 12 10:45:58 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-e0859049-bb20-4beb-be94-9bfef941d4eb req-83f365f3-a503-403e-8430-5cb7303d28d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153545 Apr 12 10:45:58 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 192/561] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:45:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:45:58 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-40728744-2609-4f9a-a229-6fcaa7b05ed0 req-3903cadd-95d3-4228-8667-663a62bf4f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6468f2a7-ce19-468d-8b8f-e6071cf437ff", "name": "network-vif-plugged", "status": "completed", "tag": "2970d881-0a68-41b7-a58c-1876abba1236"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:45:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-40728744-2609-4f9a-a229-6fcaa7b05ed0 req-3903cadd-95d3-4228-8667-663a62bf4f4f service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-40728744-2609-4f9a-a229-6fcaa7b05ed0 req-3903cadd-95d3-4228-8667-663a62bf4f4f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-40728744-2609-4f9a-a229-6fcaa7b05ed0 req-3903cadd-95d3-4228-8667-663a62bf4f4f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:58 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-40728744-2609-4f9a-a229-6fcaa7b05ed0 req-3903cadd-95d3-4228-8667-663a62bf4f4f service nova] Creating event network-vif-plugged:2970d881-0a68-41b7-a58c-1876abba1236 for instance 6468f2a7-ce19-468d-8b8f-e6071cf437ff on user Apr 12 10:45:58 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-40728744-2609-4f9a-a229-6fcaa7b05ed0 req-3903cadd-95d3-4228-8667-663a62bf4f4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031476 Apr 12 10:45:58 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 187/562] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:45:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:45:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-6a1de791-c8e0-4354-b980-18a9cbc995da tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:45:59 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-6a1de791-c8e0-4354-b980-18a9cbc995da tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:45:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6a1de791-c8e0-4354-b980-18a9cbc995da tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6a1de791-c8e0-4354-b980-18a9cbc995da tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6a1de791-c8e0-4354-b980-18a9cbc995da tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6a1de791-c8e0-4354-b980-18a9cbc995da tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:45:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6a1de791-c8e0-4354-b980-18a9cbc995da tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:45:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6a1de791-c8e0-4354-b980-18a9cbc995da tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:45:59 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-6a1de791-c8e0-4354-b980-18a9cbc995da tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] HTTP exception thrown: Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa could not be found. Apr 12 10:45:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-6a1de791-c8e0-4354-b980-18a9cbc995da tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Request method failure captured: Apr 12 10:45:59 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa HTTP/1.1 Apr 12 10:45:59 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:45:59 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:45:59 user devstack@n-api.service[61853]: Connection: close Apr 12 10:45:59 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:45:59 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:45:59 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:45:59 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:45:59 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:45:59 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNoouXVke4zrMP32TCbioIDUNa_DANk_XHzEmTqZotQork8HQI_cIXAMStkpweTbFN8OQdblBuuvjAsmiUW6DL7s_CNKxsp1Z5jZn_yTLRkDwFXP9F4-RCkbzC6peGvy2Nq9E-ebBh6b_bbwxu7VnP3XdBmxCiiEqhh1z2faBd-lIB8M Apr 12 10:45:59 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:45:59 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:45:59 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:45:59 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:45:59 user devstack@n-api.service[61853]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 10:45:59 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:45:59 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:45:59 user devstack@n-api.service[61853]: X-Project-Id: af33ce0944194932b663c3b8aef9783d Apr 12 10:45:59 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-603525697 Apr 12 10:45:59 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:45:59 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:45:59 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/af33ce0944194932b663c3b8aef9783d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af33ce0944194932b663c3b8aef9783d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af33ce0944194932b663c3b8aef9783d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:45:59 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeShelveTestJSON-603525697 Apr 12 10:45:59 user devstack@n-api.service[61853]: X-Tenant-Id: af33ce0944194932b663c3b8aef9783d Apr 12 10:45:59 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-603525697 Apr 12 10:45:59 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeShelveTestJSON-603525697-project-member Apr 12 10:45:59 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:45:59 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:45:59 user devstack@n-api.service[61853]: X-User-Id: 47d6279f1ce94008a2898ade6f730b40 Apr 12 10:45:59 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeShelveTestJSON-603525697-project-member Apr 12 10:45:59 user devstack@n-api.service[61853]: method: > Apr 12 10:45:59 user devstack@n-api.service[61853]: exception: Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa could not be found. Apr 12 10:45:59 user devstack@n-api.service[61853]: action_args: {'id': '0bfafa79-ce40-42f1-9992-10e50734f7fa'} Apr 12 10:45:59 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa could not be found. Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa could not be found. Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa could not be found. Apr 12 10:45:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:45:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-6a1de791-c8e0-4354-b980-18a9cbc995da tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Returning 404 to user: Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:45:59 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-6a1de791-c8e0-4354-b980-18a9cbc995da tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa" status: 404 len: 111 microversion: 2.20 time: 0.032045 Apr 12 10:45:59 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 184/563] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:45:59 2023] GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:45:59 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-18d75dc5-abf1-4e43-96d4-4b3ff938f96f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '.version_select at 0x7fabbf8bc1f0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:45:59 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-18d75dc5-abf1-4e43-96d4-4b3ff938f96f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1823760254" status: 204 len: 0 microversion: 2.20 time: 0.030787 Apr 12 10:45:59 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 193/564] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 10:45:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1823760254 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 10:46:00 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-0a2fce8e-476c-4879-a312-ed81d48581a7 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Action: 'create', calling method: .version_select at 0x7fabbf6d6560>, body: {"keypair": {"name": "tempest-keypair-538398767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+kfG5JhTbXJvo4JchrKmOzn92ZUEmlrTD0glXq+axhyaimCqqgKU45MbV6YpEhNYXodiKBbWNpJwThQxwbW5Ag7tRarIRqtDBp4vnVNoqqjXoHeq8fGfxhehEge51e0Q=="}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:46:00 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-0a2fce8e-476c-4879-a312-ed81d48581a7 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Getting quotas for project af33ce0944194932b663c3b8aef9783d. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:46:00 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-0a2fce8e-476c-4879-a312-ed81d48581a7 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Getting quotas for user 47d6279f1ce94008a2898ade6f730b40 and project af33ce0944194932b663c3b8aef9783d. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:46:00 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-0a2fce8e-476c-4879-a312-ed81d48581a7 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.044467 Apr 12 10:46:00 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 188/565] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 10:46:00 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 10:46:02 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-637881895", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18"}], "security_groups": [{"name": "tempest-securitygroup--1213380876"}], "key_name": "tempest-keypair-538398767", "user_data": "}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:46:02 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] validate_networks() for [('aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:46:03 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:46:03 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:46:03 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:46:03 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:46:03 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:46:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:03 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Getting quotas for project af33ce0944194932b663c3b8aef9783d. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:46:03 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Getting quotas for user 47d6279f1ce94008a2898ade6f730b40 and project af33ce0944194932b663c3b8aef9783d. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:46:03 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:46:03 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:46:03 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.571734 Apr 12 10:46:03 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 185/566] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 10:46:02 2023] POST /compute/v2.1/servers => generated 400 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 10:46:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-cdf74e3d-9aaf-4a88-95d0-43200fa183bb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:46:03 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-cdf74e3d-9aaf-4a88-95d0-43200fa183bb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:46:03 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-cdf74e3d-9aaf-4a88-95d0-43200fa183bb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:46:03 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-cdf74e3d-9aaf-4a88-95d0-43200fa183bb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:46:03 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-cdf74e3d-9aaf-4a88-95d0-43200fa183bb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:46:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-cdf74e3d-9aaf-4a88-95d0-43200fa183bb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34" status: 200 len: 1274 microversion: 2.20 time: 0.080885 Apr 12 10:46:03 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 194/567] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:46:03 2023] GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34 => generated 1274 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:46:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-588d963e-2267-44a1-aa7f-45eec92c4730 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:46:06 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-588d963e-2267-44a1-aa7f-45eec92c4730 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:46:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-588d963e-2267-44a1-aa7f-45eec92c4730 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-588d963e-2267-44a1-aa7f-45eec92c4730 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-588d963e-2267-44a1-aa7f-45eec92c4730 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-588d963e-2267-44a1-aa7f-45eec92c4730 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-588d963e-2267-44a1-aa7f-45eec92c4730 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-588d963e-2267-44a1-aa7f-45eec92c4730 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-ba879151-2f51-46e8-af28-463a1a161165 req-7936cc2d-ad5f-4a78-b854-8b13e18f2c76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76758da6-ef8f-433f-b4e8-8d72f01b6b34", "tag": "65d96800-cdfa-49fe-a407-05d5b661f452"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:46:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ba879151-2f51-46e8-af28-463a1a161165 req-7936cc2d-ad5f-4a78-b854-8b13e18f2c76 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ba879151-2f51-46e8-af28-463a1a161165 req-7936cc2d-ad5f-4a78-b854-8b13e18f2c76 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-ba879151-2f51-46e8-af28-463a1a161165 req-7936cc2d-ad5f-4a78-b854-8b13e18f2c76 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:06 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-588d963e-2267-44a1-aa7f-45eec92c4730 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:46:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-ba879151-2f51-46e8-af28-463a1a161165 req-7936cc2d-ad5f-4a78-b854-8b13e18f2c76 service nova] Creating event network-changed:65d96800-cdfa-49fe-a407-05d5b661f452 for instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 on user Apr 12 10:46:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-ba879151-2f51-46e8-af28-463a1a161165 req-7936cc2d-ad5f-4a78-b854-8b13e18f2c76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033403 Apr 12 10:46:06 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-588d963e-2267-44a1-aa7f-45eec92c4730 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3" status: 200 len: 1535 microversion: 2.1 time: 0.480778 Apr 12 10:46:06 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 186/568] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:46:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:46:06 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 189/569] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:46:06 2023] GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3 => generated 1535 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:46:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:46:08 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:46:08 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/action" status: 202 len: 0 microversion: 2.1 time: 0.161021 Apr 12 10:46:08 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 195/570] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:46:08 2023] POST /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:46:08 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a6287322-f23a-47ff-8b3c-cbcb4ab0b9af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:46:08 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a6287322-f23a-47ff-8b3c-cbcb4ab0b9af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:46:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a6287322-f23a-47ff-8b3c-cbcb4ab0b9af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a6287322-f23a-47ff-8b3c-cbcb4ab0b9af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a6287322-f23a-47ff-8b3c-cbcb4ab0b9af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a6287322-f23a-47ff-8b3c-cbcb4ab0b9af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a6287322-f23a-47ff-8b3c-cbcb4ab0b9af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a6287322-f23a-47ff-8b3c-cbcb4ab0b9af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:09 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-a6287322-f23a-47ff-8b3c-cbcb4ab0b9af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:46:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a6287322-f23a-47ff-8b3c-cbcb4ab0b9af tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1730 microversion: 2.1 time: 0.478909 Apr 12 10:46:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 187/571] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:46:08 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1730 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:46:09 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-18199ad2-3893-4fb3-873e-24c213019208 req-86465369-d25d-4135-8811-d082ab4797e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76758da6-ef8f-433f-b4e8-8d72f01b6b34", "name": "network-vif-plugged", "status": "completed", "tag": "65d96800-cdfa-49fe-a407-05d5b661f452"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:46:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-18199ad2-3893-4fb3-873e-24c213019208 req-86465369-d25d-4135-8811-d082ab4797e6 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-18199ad2-3893-4fb3-873e-24c213019208 req-86465369-d25d-4135-8811-d082ab4797e6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-18199ad2-3893-4fb3-873e-24c213019208 req-86465369-d25d-4135-8811-d082ab4797e6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:09 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-18199ad2-3893-4fb3-873e-24c213019208 req-86465369-d25d-4135-8811-d082ab4797e6 service nova] Creating event network-vif-plugged:65d96800-cdfa-49fe-a407-05d5b661f452 for instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 on user Apr 12 10:46:09 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-18199ad2-3893-4fb3-873e-24c213019208 req-86465369-d25d-4135-8811-d082ab4797e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028460 Apr 12 10:46:09 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 190/572] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:46:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:46:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76758da6-ef8f-433f-b4e8-8d72f01b6b34", "name": "network-vif-plugged", "status": "completed", "tag": "65d96800-cdfa-49fe-a407-05d5b661f452"}, {"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-unplugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}, {"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-plugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:46:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] Creating event network-vif-plugged:65d96800-cdfa-49fe-a407-05d5b661f452 for instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 on user Apr 12 10:46:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] Creating event network-vif-unplugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:46:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] Creating event network-vif-plugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:46:11 user devstack@n-api.service[61854]: DEBUG nova.compute.api [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61854) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 10:46:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.048868 Apr 12 10:46:11 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 196/573] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:46:11 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:46:13 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5b9dd76f-34d9-4ac0-a935-0588eb302bdd tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:46:13 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5b9dd76f-34d9-4ac0-a935-0588eb302bdd tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:46:13 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:13 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b9dd76f-34d9-4ac0-a935-0588eb302bdd tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b9dd76f-34d9-4ac0-a935-0588eb302bdd tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b9dd76f-34d9-4ac0-a935-0588eb302bdd tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b9dd76f-34d9-4ac0-a935-0588eb302bdd tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b9dd76f-34d9-4ac0-a935-0588eb302bdd tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5b9dd76f-34d9-4ac0-a935-0588eb302bdd tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:14 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-5b9dd76f-34d9-4ac0-a935-0588eb302bdd tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574af27cae41457c9be3d5d50d347b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef7aa45de34b01a97b6bc5e0acece5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:46:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5b9dd76f-34d9-4ac0-a935-0588eb302bdd tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e" status: 200 len: 1550 microversion: 2.1 time: 0.288495 Apr 12 10:46:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 188/574] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:46:13 2023] GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e => generated 1550 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:46:21 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:21 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:21 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:21 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-803081492", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "fcd3e73e-84d4-4ba4-a63d-270062819303", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "3ecf6069-4851-431c-a1c3-13e94566fa0b"}]}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:46:21 user devstack@n-api.service[61852]: DEBUG nova.network.neutron [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] validate_networks() for [('3ecf6069-4851-431c-a1c3-13e94566fa0b', None, None, None, None, None)] {{(pid=61852) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:46:21 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-064e1694-f27b-4191-b97a-fdc6d528d1dc req-13b977f7-f46b-4807-a1a9-58081b95fc89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-plugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:46:21 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:21 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:21 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-064e1694-f27b-4191-b97a-fdc6d528d1dc req-13b977f7-f46b-4807-a1a9-58081b95fc89 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-064e1694-f27b-4191-b97a-fdc6d528d1dc req-13b977f7-f46b-4807-a1a9-58081b95fc89 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-064e1694-f27b-4191-b97a-fdc6d528d1dc req-13b977f7-f46b-4807-a1a9-58081b95fc89 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-064e1694-f27b-4191-b97a-fdc6d528d1dc req-13b977f7-f46b-4807-a1a9-58081b95fc89 service nova] Creating event network-vif-plugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:46:22 user devstack@n-api.service[61854]: DEBUG nova.compute.api [req-064e1694-f27b-4191-b97a-fdc6d528d1dc req-13b977f7-f46b-4807-a1a9-58081b95fc89 service nova] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61854) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 10:46:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-064e1694-f27b-4191-b97a-fdc6d528d1dc req-13b977f7-f46b-4807-a1a9-58081b95fc89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175920 Apr 12 10:46:22 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 197/575] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:46:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:46:22 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:46:22 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:46:22 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:46:22 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:46:22 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:46:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:22 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:22 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting quotas for project a67f3d23b8f74a9496d445c7fc75717e. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:46:22 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting quotas for user b914d7ca786f455baf120f98816abffd and project a67f3d23b8f74a9496d445c7fc75717e. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:46:22 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Going to run 1 instances... {{(pid=61852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:46:22 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='fcd3e73e-84d4-4ba4-a63d-270062819303',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:46:22 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.918911 Apr 12 10:46:22 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 191/576] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:46:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:46:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-85cc76b4-9a16-4d5e-9a2a-b9cc1af9b5c0 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:46:22 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-85cc76b4-9a16-4d5e-9a2a-b9cc1af9b5c0 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:46:22 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-85cc76b4-9a16-4d5e-9a2a-b9cc1af9b5c0 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:46:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-85cc76b4-9a16-4d5e-9a2a-b9cc1af9b5c0 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec" status: 200 len: 1051 microversion: 2.1 time: 0.088360 Apr 12 10:46:22 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 189/577] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:46:22 2023] GET /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec => generated 1051 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:46:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-43b13a1e-2c64-4e61-a18c-a78a00595052 req-ff4b200d-2d72-40b7-a091-aac462bcd263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-plugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:46:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-43b13a1e-2c64-4e61-a18c-a78a00595052 req-ff4b200d-2d72-40b7-a091-aac462bcd263 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-43b13a1e-2c64-4e61-a18c-a78a00595052 req-ff4b200d-2d72-40b7-a091-aac462bcd263 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-43b13a1e-2c64-4e61-a18c-a78a00595052 req-ff4b200d-2d72-40b7-a091-aac462bcd263 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-43b13a1e-2c64-4e61-a18c-a78a00595052 req-ff4b200d-2d72-40b7-a091-aac462bcd263 service nova] Creating event network-vif-plugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:46:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-43b13a1e-2c64-4e61-a18c-a78a00595052 req-ff4b200d-2d72-40b7-a091-aac462bcd263 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036306 Apr 12 10:46:24 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 198/578] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:46:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:46:26 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-3f074330-c822-47c5-93d5-8cf3bbbae0fc req-e6d3039a-77ba-4203-9199-c0de170e4a5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5a8d3c-a65a-4a05-9874-ad22b597ddec", "tag": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:46:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-3f074330-c822-47c5-93d5-8cf3bbbae0fc req-e6d3039a-77ba-4203-9199-c0de170e4a5c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-3f074330-c822-47c5-93d5-8cf3bbbae0fc req-e6d3039a-77ba-4203-9199-c0de170e4a5c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-3f074330-c822-47c5-93d5-8cf3bbbae0fc req-e6d3039a-77ba-4203-9199-c0de170e4a5c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:26 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-3f074330-c822-47c5-93d5-8cf3bbbae0fc req-e6d3039a-77ba-4203-9199-c0de170e4a5c service nova] Creating event network-changed:363567f1-4d02-4e70-aba9-b7b5c7e2b7ab for instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec on user Apr 12 10:46:26 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-3f074330-c822-47c5-93d5-8cf3bbbae0fc req-e6d3039a-77ba-4203-9199-c0de170e4a5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047451 Apr 12 10:46:26 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 192/579] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:46:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:46:33 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-139f4921-ba4a-438a-90fa-6cbc6037d507 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:46:33 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-139f4921-ba4a-438a-90fa-6cbc6037d507 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:46:33 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=26 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:33 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:33 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-139f4921-ba4a-438a-90fa-6cbc6037d507 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-139f4921-ba4a-438a-90fa-6cbc6037d507 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-139f4921-ba4a-438a-90fa-6cbc6037d507 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-139f4921-ba4a-438a-90fa-6cbc6037d507 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-139f4921-ba4a-438a-90fa-6cbc6037d507 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-139f4921-ba4a-438a-90fa-6cbc6037d507 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:33 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-139f4921-ba4a-438a-90fa-6cbc6037d507 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:46:33 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-139f4921-ba4a-438a-90fa-6cbc6037d507 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48" status: 200 len: 1504 microversion: 2.1 time: 0.189873 Apr 12 10:46:33 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 190/580] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:46:33 2023] GET /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48 => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:46:37 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:37 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:37 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-9fd80e78-2342-4545-a588-f86296e3f8d5 req-0ddd8f9b-6309-4b79-8506-03a634348aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5a8d3c-a65a-4a05-9874-ad22b597ddec", "name": "network-vif-plugged", "status": "completed", "tag": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:46:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9fd80e78-2342-4545-a588-f86296e3f8d5 req-0ddd8f9b-6309-4b79-8506-03a634348aed service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9fd80e78-2342-4545-a588-f86296e3f8d5 req-0ddd8f9b-6309-4b79-8506-03a634348aed service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9fd80e78-2342-4545-a588-f86296e3f8d5 req-0ddd8f9b-6309-4b79-8506-03a634348aed service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:37 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-9fd80e78-2342-4545-a588-f86296e3f8d5 req-0ddd8f9b-6309-4b79-8506-03a634348aed service nova] Creating event network-vif-plugged:363567f1-4d02-4e70-aba9-b7b5c7e2b7ab for instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec on user Apr 12 10:46:37 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-9fd80e78-2342-4545-a588-f86296e3f8d5 req-0ddd8f9b-6309-4b79-8506-03a634348aed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041516 Apr 12 10:46:37 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 199/581] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:46:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:46:39 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:39 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:39 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:39 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:39 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-4c1e66eb-1d38-4303-bbf7-2986e60b02b5 req-453849de-d50f-42f3-9aef-514ef1896646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5a8d3c-a65a-4a05-9874-ad22b597ddec", "name": "network-vif-plugged", "status": "completed", "tag": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:46:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-4c1e66eb-1d38-4303-bbf7-2986e60b02b5 req-453849de-d50f-42f3-9aef-514ef1896646 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-4c1e66eb-1d38-4303-bbf7-2986e60b02b5 req-453849de-d50f-42f3-9aef-514ef1896646 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-4c1e66eb-1d38-4303-bbf7-2986e60b02b5 req-453849de-d50f-42f3-9aef-514ef1896646 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:39 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-4c1e66eb-1d38-4303-bbf7-2986e60b02b5 req-453849de-d50f-42f3-9aef-514ef1896646 service nova] Creating event network-vif-plugged:363567f1-4d02-4e70-aba9-b7b5c7e2b7ab for instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec on user Apr 12 10:46:39 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-4c1e66eb-1d38-4303-bbf7-2986e60b02b5 req-453849de-d50f-42f3-9aef-514ef1896646 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042019 Apr 12 10:46:39 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 193/582] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:46:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:46:40 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-64e7a6d8-cbab-4859-b687-bd15e5080c84 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:46:40 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-64e7a6d8-cbab-4859-b687-bd15e5080c84 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:46:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-64e7a6d8-cbab-4859-b687-bd15e5080c84 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-64e7a6d8-cbab-4859-b687-bd15e5080c84 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-64e7a6d8-cbab-4859-b687-bd15e5080c84 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-64e7a6d8-cbab-4859-b687-bd15e5080c84 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-64e7a6d8-cbab-4859-b687-bd15e5080c84 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-64e7a6d8-cbab-4859-b687-bd15e5080c84 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-64e7a6d8-cbab-4859-b687-bd15e5080c84 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.091627 Apr 12 10:46:40 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 191/583] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 10:46:40 2023] GET /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44/os-interface => generated 282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:46:41 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-369dd189-6950-4302-b959-970f7462dd6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:46:41 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-369dd189-6950-4302-b959-970f7462dd6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:46:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-369dd189-6950-4302-b959-970f7462dd6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-369dd189-6950-4302-b959-970f7462dd6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-369dd189-6950-4302-b959-970f7462dd6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-369dd189-6950-4302-b959-970f7462dd6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-369dd189-6950-4302-b959-970f7462dd6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-369dd189-6950-4302-b959-970f7462dd6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:41 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-369dd189-6950-4302-b959-970f7462dd6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44/ips" status: 200 len: 107 microversion: 2.1 time: 0.036430 Apr 12 10:46:41 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 194/584] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 10:46:41 2023] GET /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44/ips => generated 107 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:46:41 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f4252268-875c-4cf9-8e46-3bc3bfe43d58 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "520ed03a-e80e-4bc4-afed-57601fa90711"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:46:41 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f4252268-875c-4cf9-8e46-3bc3bfe43d58 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:46:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f4252268-875c-4cf9-8e46-3bc3bfe43d58 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f4252268-875c-4cf9-8e46-3bc3bfe43d58 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f4252268-875c-4cf9-8e46-3bc3bfe43d58 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f4252268-875c-4cf9-8e46-3bc3bfe43d58 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f4252268-875c-4cf9-8e46-3bc3bfe43d58 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f4252268-875c-4cf9-8e46-3bc3bfe43d58 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-cbd7a418-85fe-451b-a3b6-156868b02b78 req-068adbe3-c4fd-404a-b65b-3965ba00183a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979fbc15-1dd0-46b8-a9c4-54be9d93da44", "tag": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:46:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cbd7a418-85fe-451b-a3b6-156868b02b78 req-068adbe3-c4fd-404a-b65b-3965ba00183a service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cbd7a418-85fe-451b-a3b6-156868b02b78 req-068adbe3-c4fd-404a-b65b-3965ba00183a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cbd7a418-85fe-451b-a3b6-156868b02b78 req-068adbe3-c4fd-404a-b65b-3965ba00183a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-cbd7a418-85fe-451b-a3b6-156868b02b78 req-068adbe3-c4fd-404a-b65b-3965ba00183a service nova] Creating event network-changed:84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 for instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 on user Apr 12 10:46:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-cbd7a418-85fe-451b-a3b6-156868b02b78 req-068adbe3-c4fd-404a-b65b-3965ba00183a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163347 Apr 12 10:46:41 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 200/585] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:46:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:46:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-f4252268-875c-4cf9-8e46-3bc3bfe43d58 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] HTTP exception thrown: Invalid volume: volume 520ed03a-e80e-4bc4-afed-57601fa90711 is already attached to instances: 4b79f4d7-f34e-4971-8a6f-171c2d71d683 Apr 12 10:46:41 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f4252268-875c-4cf9-8e46-3bc3bfe43d58 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Request method failure captured: Apr 12 10:46:41 user devstack@n-api.service[61853]: request: POST /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44/os-volume_attachments HTTP/1.1 Apr 12 10:46:41 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:46:41 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:46:41 user devstack@n-api.service[61853]: Connection: close Apr 12 10:46:41 user devstack@n-api.service[61853]: Content-Length: 74 Apr 12 10:46:41 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:46:41 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:46:41 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:46:41 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:46:41 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNosjxmxcVjmUpCMLAxdRdLndUlKxh4MkCcirUvRtNoND63IGb1xoGABQC8D9rLRE4dW_L0z2oNcBU8jtABVmL5XlYtTU15Uvd1NUbrH9hi6BA13fINZDRHpVQlP0DCe8J969vT87xyN1x_qfcLnOr5CvtvwcJHsWkRykm4XG-p9tMms Apr 12 10:46:41 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:46:41 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:46:41 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:46:41 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:46:41 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:46:41 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:46:41 user devstack@n-api.service[61853]: X-Project-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:46:41 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:46:41 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:46:41 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:46:41 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:46:41 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:46:41 user devstack@n-api.service[61853]: X-Tenant-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:46:41 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:46:41 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:46:41 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:46:41 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:46:41 user devstack@n-api.service[61853]: X-User-Id: 7ec47d3cdacb45e5a39509e76b546e34 Apr 12 10:46:41 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:46:41 user devstack@n-api.service[61853]: Apr 12 10:46:41 user devstack@n-api.service[61853]: {"volumeAttachment": {"volumeId": "520ed03a-e80e-4bc4-afed-57601fa90711"}} Apr 12 10:46:41 user devstack@n-api.service[61853]: method: > Apr 12 10:46:41 user devstack@n-api.service[61853]: exception: Invalid volume: volume 520ed03a-e80e-4bc4-afed-57601fa90711 is already attached to instances: 4b79f4d7-f34e-4971-8a6f-171c2d71d683 Apr 12 10:46:41 user devstack@n-api.service[61853]: action_args: {'server_id': '979fbc15-1dd0-46b8-a9c4-54be9d93da44', 'body': {'volumeAttachment': {'volumeId': '520ed03a-e80e-4bc4-afed-57601fa90711'}}} Apr 12 10:46:41 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 520ed03a-e80e-4bc4-afed-57601fa90711 is already attached to instances: 4b79f4d7-f34e-4971-8a6f-171c2d71d683 Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 520ed03a-e80e-4bc4-afed-57601fa90711 is already attached to instances: 4b79f4d7-f34e-4971-8a6f-171c2d71d683 Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 520ed03a-e80e-4bc4-afed-57601fa90711 is already attached to instances: 4b79f4d7-f34e-4971-8a6f-171c2d71d683 Apr 12 10:46:41 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:46:41 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f4252268-875c-4cf9-8e46-3bc3bfe43d58 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Returning 400 to user: Invalid volume: volume 520ed03a-e80e-4bc4-afed-57601fa90711 is already attached to instances: 4b79f4d7-f34e-4971-8a6f-171c2d71d683 {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:46:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f4252268-875c-4cf9-8e46-3bc3bfe43d58 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "POST /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102074 Apr 12 10:46:41 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 192/586] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:46:41 2023] POST /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:46:41 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:46:41 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:46:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:41 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:46:41 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44" status: 204 len: 0 microversion: 2.1 time: 0.124656 Apr 12 10:46:41 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 195/587] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:46:41 2023] DELETE /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:46:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-6437d37a-0212-446d-8b3a-21117fcd3ad2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:46:41 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-6437d37a-0212-446d-8b3a-21117fcd3ad2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:46:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6437d37a-0212-446d-8b3a-21117fcd3ad2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6437d37a-0212-446d-8b3a-21117fcd3ad2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6437d37a-0212-446d-8b3a-21117fcd3ad2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6437d37a-0212-446d-8b3a-21117fcd3ad2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6437d37a-0212-446d-8b3a-21117fcd3ad2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-6437d37a-0212-446d-8b3a-21117fcd3ad2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:42 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-6437d37a-0212-446d-8b3a-21117fcd3ad2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec47d3cdacb45e5a39509e76b546e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cecbfbfd5f42dbb663367f6fbdf3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:46:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-6437d37a-0212-446d-8b3a-21117fcd3ad2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44" status: 200 len: 1550 microversion: 2.1 time: 0.226556 Apr 12 10:46:42 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 201/588] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:46:41 2023] GET /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44 => generated 1550 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:46:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-16473cfc-7447-4d96-a938-1f5db946f531 req-c73aef09-11c1-47e9-a646-2eb360cee06f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979fbc15-1dd0-46b8-a9c4-54be9d93da44", "name": "network-vif-deleted", "tag": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:46:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-16473cfc-7447-4d96-a938-1f5db946f531 req-c73aef09-11c1-47e9-a646-2eb360cee06f service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-16473cfc-7447-4d96-a938-1f5db946f531 req-c73aef09-11c1-47e9-a646-2eb360cee06f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-16473cfc-7447-4d96-a938-1f5db946f531 req-c73aef09-11c1-47e9-a646-2eb360cee06f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-16473cfc-7447-4d96-a938-1f5db946f531 req-c73aef09-11c1-47e9-a646-2eb360cee06f service nova] Creating event network-vif-deleted:84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 for instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 on user Apr 12 10:46:43 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-16473cfc-7447-4d96-a938-1f5db946f531 req-c73aef09-11c1-47e9-a646-2eb360cee06f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098291 Apr 12 10:46:43 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 193/589] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:46:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:46:43 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979fbc15-1dd0-46b8-a9c4-54be9d93da44", "name": "network-vif-unplugged", "status": "completed", "tag": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0"}, {"server_uuid": "979fbc15-1dd0-46b8-a9c4-54be9d93da44", "name": "network-vif-plugged", "status": "completed", "tag": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:46:43 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:43 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:43 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:43 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] Creating event network-vif-unplugged:84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 for instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 on user Apr 12 10:46:43 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] Creating event network-vif-plugged:84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 for instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 on user Apr 12 10:46:43 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033811 Apr 12 10:46:43 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 196/590] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:46:43 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:46:46 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-36e17a0f-ad95-4f52-8871-360a4217e372 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:46:46 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-36e17a0f-ad95-4f52-8871-360a4217e372 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:46:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36e17a0f-ad95-4f52-8871-360a4217e372 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36e17a0f-ad95-4f52-8871-360a4217e372 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36e17a0f-ad95-4f52-8871-360a4217e372 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36e17a0f-ad95-4f52-8871-360a4217e372 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36e17a0f-ad95-4f52-8871-360a4217e372 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-36e17a0f-ad95-4f52-8871-360a4217e372 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:46 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-36e17a0f-ad95-4f52-8871-360a4217e372 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] HTTP exception thrown: Instance 6468f2a7-ce19-468d-8b8f-e6071cf437ff could not be found. Apr 12 10:46:46 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-36e17a0f-ad95-4f52-8871-360a4217e372 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Request method failure captured: Apr 12 10:46:46 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/6468f2a7-ce19-468d-8b8f-e6071cf437ff HTTP/1.1 Apr 12 10:46:46 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:46:46 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:46:46 user devstack@n-api.service[61854]: Connection: close Apr 12 10:46:46 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:46:46 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:46:46 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:46:46 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:46:46 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:46:46 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNorQoc7u3Xvn57Cv4akmfG7wvpf4MRLYQCt_8MJi4ZhPBJz4HkJ42rgebgBr9ot3mMfh-hLqvwGGKrNAzyFJimoMsdfEyg_T0AXIRB3wJlt2_9mgM6oadlqM3-iOfnfwHg9ayqNgrmylaZkp-A92_bWN3Eu0UG5O9w_MN34lDFH98WE Apr 12 10:46:46 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:46:46 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:46:46 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:46:46 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:46:46 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:46:46 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:46:46 user devstack@n-api.service[61854]: X-Project-Id: 71bb70c871154a14947ea3421553a229 Apr 12 10:46:46 user devstack@n-api.service[61854]: X-Project-Name: tempest-VolumesActionsTest-715093810 Apr 12 10:46:46 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:46:46 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:46:46 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71bb70c871154a14947ea3421553a229"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71bb70c871154a14947ea3421553a229"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71bb70c871154a14947ea3421553a229"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:46:46 user devstack@n-api.service[61854]: X-Tenant: tempest-VolumesActionsTest-715093810 Apr 12 10:46:46 user devstack@n-api.service[61854]: X-Tenant-Id: 71bb70c871154a14947ea3421553a229 Apr 12 10:46:46 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-VolumesActionsTest-715093810 Apr 12 10:46:46 user devstack@n-api.service[61854]: X-User: tempest-VolumesActionsTest-715093810-project-member Apr 12 10:46:46 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:46:46 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:46:46 user devstack@n-api.service[61854]: X-User-Id: bccad0e37147441cb68130a22197a5d4 Apr 12 10:46:46 user devstack@n-api.service[61854]: X-User-Name: tempest-VolumesActionsTest-715093810-project-member Apr 12 10:46:46 user devstack@n-api.service[61854]: method: > Apr 12 10:46:46 user devstack@n-api.service[61854]: exception: Instance 6468f2a7-ce19-468d-8b8f-e6071cf437ff could not be found. Apr 12 10:46:46 user devstack@n-api.service[61854]: action_args: {'id': '6468f2a7-ce19-468d-8b8f-e6071cf437ff'} Apr 12 10:46:46 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6468f2a7-ce19-468d-8b8f-e6071cf437ff could not be found. Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6468f2a7-ce19-468d-8b8f-e6071cf437ff could not be found. Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6468f2a7-ce19-468d-8b8f-e6071cf437ff could not be found. Apr 12 10:46:46 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:46:46 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-36e17a0f-ad95-4f52-8871-360a4217e372 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Returning 404 to user: Instance 6468f2a7-ce19-468d-8b8f-e6071cf437ff could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:46:46 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-36e17a0f-ad95-4f52-8871-360a4217e372 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6468f2a7-ce19-468d-8b8f-e6071cf437ff" status: 404 len: 111 microversion: 2.1 time: 0.222641 Apr 12 10:46:46 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 202/591] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:46:46 2023] GET /compute/v2.1/servers/6468f2a7-ce19-468d-8b8f-e6071cf437ff => generated 111 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:46:53 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-432183052", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "destination_type": "volume"}], "networks": [{"uuid": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e"}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:46:53 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] validate_networks() for [('49a2fb41-5e5e-4d4b-969a-0043778b4b0e', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:46:53 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=18 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:46:53 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-42f1af2a-5da4-4953-a369-68c3341843a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:46:53 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-42f1af2a-5da4-4953-a369-68c3341843a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:46:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-42f1af2a-5da4-4953-a369-68c3341843a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-42f1af2a-5da4-4953-a369-68c3341843a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-42f1af2a-5da4-4953-a369-68c3341843a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-42f1af2a-5da4-4953-a369-68c3341843a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-42f1af2a-5da4-4953-a369-68c3341843a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-42f1af2a-5da4-4953-a369-68c3341843a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:53 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-42f1af2a-5da4-4953-a369-68c3341843a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:46:53 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-42f1af2a-5da4-4953-a369-68c3341843a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:46:53 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-42f1af2a-5da4-4953-a369-68c3341843a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:46:53 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-42f1af2a-5da4-4953-a369-68c3341843a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34" status: 200 len: 1586 microversion: 2.20 time: 0.160913 Apr 12 10:46:53 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 197/592] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:46:53 2023] GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34 => generated 1586 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:46:53 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:46:53 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:46:53 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:46:53 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:46:53 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:46:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:53 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Getting quotas for project 3789b59ccc704f86afac83af21fd84f9. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:46:53 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Getting quotas for user ba49b947c74e48f3b161b6f9fce8b1c5 and project 3789b59ccc704f86afac83af21fd84f9. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:46:54 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:46:54 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:46:54 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.866545 Apr 12 10:46:54 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 194/593] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 10:46:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 10:46:54 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2e6b307e-933f-4904-a27a-9b7081e31e50 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:46:54 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-2e6b307e-933f-4904-a27a-9b7081e31e50 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:46:54 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-2e6b307e-933f-4904-a27a-9b7081e31e50 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:46:54 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-2e6b307e-933f-4904-a27a-9b7081e31e50 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:46:54 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-2e6b307e-933f-4904-a27a-9b7081e31e50 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:46:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2e6b307e-933f-4904-a27a-9b7081e31e50 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" status: 200 len: 1394 microversion: 2.87 time: 0.087606 Apr 12 10:46:54 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 203/594] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:46:54 2023] GET /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa => generated 1394 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:46:56 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-8c7d4b33-f650-4b30-aec9-50904c3dabb0 req-1292ccc4-26db-4a75-bd4d-238224f62832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa", "tag": "48ecbe51-c168-45fd-9029-d5cfa270e5c5"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:46:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-8c7d4b33-f650-4b30-aec9-50904c3dabb0 req-1292ccc4-26db-4a75-bd4d-238224f62832 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-8c7d4b33-f650-4b30-aec9-50904c3dabb0 req-1292ccc4-26db-4a75-bd4d-238224f62832 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-8c7d4b33-f650-4b30-aec9-50904c3dabb0 req-1292ccc4-26db-4a75-bd4d-238224f62832 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:56 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-8c7d4b33-f650-4b30-aec9-50904c3dabb0 req-1292ccc4-26db-4a75-bd4d-238224f62832 service nova] Creating event network-changed:48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa on user Apr 12 10:46:56 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-8c7d4b33-f650-4b30-aec9-50904c3dabb0 req-1292ccc4-26db-4a75-bd4d-238224f62832 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045991 Apr 12 10:46:56 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 198/595] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:46:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:46:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-80ce8b23-df83-4303-9eaf-6a24d8595a75 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:46:59 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-80ce8b23-df83-4303-9eaf-6a24d8595a75 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:46:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-80ce8b23-df83-4303-9eaf-6a24d8595a75 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-80ce8b23-df83-4303-9eaf-6a24d8595a75 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-80ce8b23-df83-4303-9eaf-6a24d8595a75 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-80ce8b23-df83-4303-9eaf-6a24d8595a75 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:46:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-80ce8b23-df83-4303-9eaf-6a24d8595a75 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:46:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-80ce8b23-df83-4303-9eaf-6a24d8595a75 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:46:59 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-80ce8b23-df83-4303-9eaf-6a24d8595a75 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:46:59 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-80ce8b23-df83-4303-9eaf-6a24d8595a75 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1723 microversion: 2.1 time: 0.220580 Apr 12 10:46:59 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 195/596] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:46:59 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 10:47:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e1d5bb41-fad7-47a0-8acf-464410b74f49 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:06 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e1d5bb41-fad7-47a0-8acf-464410b74f49 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:06 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=12 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:47:06 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:47:06 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=14 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:47:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e1d5bb41-fad7-47a0-8acf-464410b74f49 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e1d5bb41-fad7-47a0-8acf-464410b74f49 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e1d5bb41-fad7-47a0-8acf-464410b74f49 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e1d5bb41-fad7-47a0-8acf-464410b74f49 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e1d5bb41-fad7-47a0-8acf-464410b74f49 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e1d5bb41-fad7-47a0-8acf-464410b74f49 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:07 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-e1d5bb41-fad7-47a0-8acf-464410b74f49 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:47:07 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-e1d5bb41-fad7-47a0-8acf-464410b74f49 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3" status: 200 len: 1535 microversion: 2.1 time: 0.182947 Apr 12 10:47:07 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 204/597] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:47:06 2023] GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3 => generated 1535 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 10:47:07 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:47:07 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:47:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-3d58881f-bdc7-4aad-86d1-57ab80bd5649 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:07 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-3d58881f-bdc7-4aad-86d1-57ab80bd5649 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:47:07 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-3d58881f-bdc7-4aad-86d1-57ab80bd5649 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Searching by: {'deleted': False, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408'} {{(pid=61852) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 12 10:47:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d58881f-bdc7-4aad-86d1-57ab80bd5649 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d58881f-bdc7-4aad-86d1-57ab80bd5649 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d58881f-bdc7-4aad-86d1-57ab80bd5649 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d58881f-bdc7-4aad-86d1-57ab80bd5649 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d58881f-bdc7-4aad-86d1-57ab80bd5649 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d58881f-bdc7-4aad-86d1-57ab80bd5649 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:07 user devstack@n-api.service[61852]: DEBUG nova.compute.multi_cell_list [None req-3d58881f-bdc7-4aad-86d1-57ab80bd5649 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61852) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 10:47:07 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-3d58881f-bdc7-4aad-86d1-57ab80bd5649 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.174303 Apr 12 10:47:07 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 199/598] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 12 10:47:07 2023] GET /compute/v2.1/servers => generated 340 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1c7ef941-5554-4c23-ab68-47857f41d713 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:07 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-1c7ef941-5554-4c23-ab68-47857f41d713 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:07 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:47:07 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:47:07 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:47:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1c7ef941-5554-4c23-ab68-47857f41d713 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1c7ef941-5554-4c23-ab68-47857f41d713 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1c7ef941-5554-4c23-ab68-47857f41d713 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1c7ef941-5554-4c23-ab68-47857f41d713 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1c7ef941-5554-4c23-ab68-47857f41d713 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1c7ef941-5554-4c23-ab68-47857f41d713 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:07 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-1c7ef941-5554-4c23-ab68-47857f41d713 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:47:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1c7ef941-5554-4c23-ab68-47857f41d713 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3" status: 200 len: 1535 microversion: 2.1 time: 0.163231 Apr 12 10:47:07 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 196/599] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:47:07 2023] GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3 => generated 1535 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 10:47:10 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-8cc5045e-aeab-4357-be56-62989a9f788a req-3c666239-13fd-42b3-9bc4-24d525660804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa", "name": "network-vif-plugged", "status": "completed", "tag": "48ecbe51-c168-45fd-9029-d5cfa270e5c5"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8cc5045e-aeab-4357-be56-62989a9f788a req-3c666239-13fd-42b3-9bc4-24d525660804 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8cc5045e-aeab-4357-be56-62989a9f788a req-3c666239-13fd-42b3-9bc4-24d525660804 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8cc5045e-aeab-4357-be56-62989a9f788a req-3c666239-13fd-42b3-9bc4-24d525660804 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-8cc5045e-aeab-4357-be56-62989a9f788a req-3c666239-13fd-42b3-9bc4-24d525660804 service nova] Creating event network-vif-plugged:48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa on user Apr 12 10:47:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-8cc5045e-aeab-4357-be56-62989a9f788a req-3c666239-13fd-42b3-9bc4-24d525660804 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043673 Apr 12 10:47:10 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 205/600] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:47:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:10 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28d188bd-314c-45f4-b762-cb2b3be5b226"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:10 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:11 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384461 Apr 12 10:47:11 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 200/601] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:47:10 2023] POST /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:12 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-70d73ac6-272d-4824-a080-64a0ab3d3ab1 req-9134ceaf-b464-46fb-b767-a3d8175a9247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa", "name": "network-vif-plugged", "status": "completed", "tag": "48ecbe51-c168-45fd-9029-d5cfa270e5c5"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-70d73ac6-272d-4824-a080-64a0ab3d3ab1 req-9134ceaf-b464-46fb-b767-a3d8175a9247 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-70d73ac6-272d-4824-a080-64a0ab3d3ab1 req-9134ceaf-b464-46fb-b767-a3d8175a9247 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-70d73ac6-272d-4824-a080-64a0ab3d3ab1 req-9134ceaf-b464-46fb-b767-a3d8175a9247 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:12 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-70d73ac6-272d-4824-a080-64a0ab3d3ab1 req-9134ceaf-b464-46fb-b767-a3d8175a9247 service nova] Creating event network-vif-plugged:48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa on user Apr 12 10:47:12 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-70d73ac6-272d-4824-a080-64a0ab3d3ab1 req-9134ceaf-b464-46fb-b767-a3d8175a9247 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032139 Apr 12 10:47:12 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 197/602] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:47:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:12 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5787fa73-e9c1-45b2-849c-1fceb1e8861e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:12 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-5787fa73-e9c1-45b2-849c-1fceb1e8861e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5787fa73-e9c1-45b2-849c-1fceb1e8861e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5787fa73-e9c1-45b2-849c-1fceb1e8861e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5787fa73-e9c1-45b2-849c-1fceb1e8861e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5787fa73-e9c1-45b2-849c-1fceb1e8861e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5787fa73-e9c1-45b2-849c-1fceb1e8861e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5787fa73-e9c1-45b2-849c-1fceb1e8861e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:13 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-5787fa73-e9c1-45b2-849c-1fceb1e8861e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:47:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5787fa73-e9c1-45b2-849c-1fceb1e8861e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec" status: 200 len: 1377 microversion: 2.1 time: 0.457789 Apr 12 10:47:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 206/603] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:47:12 2023] GET /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec => generated 1377 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:47:15 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:15 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:15 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-05c10d7a-d07c-40d3-9da2-8a0b0e8c39e3 req-8a55909b-ffd7-4c9e-abc1-cf8fe59e9c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b29390-867e-4bf3-bc93-b401f32b130e", "tag": "78a8426a-653a-44cb-80b7-8a8b14d78cf4"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-05c10d7a-d07c-40d3-9da2-8a0b0e8c39e3 req-8a55909b-ffd7-4c9e-abc1-cf8fe59e9c5e service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-05c10d7a-d07c-40d3-9da2-8a0b0e8c39e3 req-8a55909b-ffd7-4c9e-abc1-cf8fe59e9c5e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-05c10d7a-d07c-40d3-9da2-8a0b0e8c39e3 req-8a55909b-ffd7-4c9e-abc1-cf8fe59e9c5e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:15 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:47:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-05c10d7a-d07c-40d3-9da2-8a0b0e8c39e3 req-8a55909b-ffd7-4c9e-abc1-cf8fe59e9c5e service nova] Creating event network-changed:78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance 68b29390-867e-4bf3-bc93-b401f32b130e on user Apr 12 10:47:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-05c10d7a-d07c-40d3-9da2-8a0b0e8c39e3 req-8a55909b-ffd7-4c9e-abc1-cf8fe59e9c5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052690 Apr 12 10:47:15 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 198/604] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:47:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e" status: 204 len: 0 microversion: 2.1 time: 0.144649 Apr 12 10:47:15 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 201/605] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:47:15 2023] DELETE /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:47:15 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b5e97177-afa7-46ae-888b-ac8700e23125 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:15 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-b5e97177-afa7-46ae-888b-ac8700e23125 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b5e97177-afa7-46ae-888b-ac8700e23125 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b5e97177-afa7-46ae-888b-ac8700e23125 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b5e97177-afa7-46ae-888b-ac8700e23125 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b5e97177-afa7-46ae-888b-ac8700e23125 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b5e97177-afa7-46ae-888b-ac8700e23125 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b5e97177-afa7-46ae-888b-ac8700e23125 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:15 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-f76ae28e-6036-47fb-9bfb-8766d1fa80b5 req-db73a3f9-80f6-4f2f-be36-0ff326a4598e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b29390-867e-4bf3-bc93-b401f32b130e", "name": "network-vif-unplugged", "status": "completed", "tag": "78a8426a-653a-44cb-80b7-8a8b14d78cf4"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:15 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-b5e97177-afa7-46ae-888b-ac8700e23125 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '574af27cae41457c9be3d5d50d347b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef7aa45de34b01a97b6bc5e0acece5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:47:15 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b5e97177-afa7-46ae-888b-ac8700e23125 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e" status: 200 len: 1556 microversion: 2.1 time: 0.309090 Apr 12 10:47:15 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 207/606] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:47:15 2023] GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e => generated 1556 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:47:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f76ae28e-6036-47fb-9bfb-8766d1fa80b5 req-db73a3f9-80f6-4f2f-be36-0ff326a4598e service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f76ae28e-6036-47fb-9bfb-8766d1fa80b5 req-db73a3f9-80f6-4f2f-be36-0ff326a4598e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f76ae28e-6036-47fb-9bfb-8766d1fa80b5 req-db73a3f9-80f6-4f2f-be36-0ff326a4598e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-f76ae28e-6036-47fb-9bfb-8766d1fa80b5 req-db73a3f9-80f6-4f2f-be36-0ff326a4598e service nova] Creating event network-vif-unplugged:78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance 68b29390-867e-4bf3-bc93-b401f32b130e on user Apr 12 10:47:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-f76ae28e-6036-47fb-9bfb-8766d1fa80b5 req-db73a3f9-80f6-4f2f-be36-0ff326a4598e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057692 Apr 12 10:47:15 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 199/607] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:47:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:17 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-481c131b-f6ce-4306-816b-374c9fc0f7b0 req-72df544c-3b80-4286-b33f-ec1f46bd0ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b29390-867e-4bf3-bc93-b401f32b130e", "name": "network-vif-plugged", "status": "completed", "tag": "78a8426a-653a-44cb-80b7-8a8b14d78cf4"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:17 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:47:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-481c131b-f6ce-4306-816b-374c9fc0f7b0 req-72df544c-3b80-4286-b33f-ec1f46bd0ab0 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-481c131b-f6ce-4306-816b-374c9fc0f7b0 req-72df544c-3b80-4286-b33f-ec1f46bd0ab0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-481c131b-f6ce-4306-816b-374c9fc0f7b0 req-72df544c-3b80-4286-b33f-ec1f46bd0ab0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:17 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-481c131b-f6ce-4306-816b-374c9fc0f7b0 req-72df544c-3b80-4286-b33f-ec1f46bd0ab0 service nova] Creating event network-vif-plugged:78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance 68b29390-867e-4bf3-bc93-b401f32b130e on user Apr 12 10:47:17 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-481c131b-f6ce-4306-816b-374c9fc0f7b0 req-72df544c-3b80-4286-b33f-ec1f46bd0ab0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036875 Apr 12 10:47:17 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 202/608] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:47:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:47:18 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-62c8bd24-3268-45f0-9b55-4603845d24a4 req-3f583066-5bea-4896-a961-a2283cd53e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b29390-867e-4bf3-bc93-b401f32b130e", "name": "network-vif-deleted", "tag": "78a8426a-653a-44cb-80b7-8a8b14d78cf4"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-62c8bd24-3268-45f0-9b55-4603845d24a4 req-3f583066-5bea-4896-a961-a2283cd53e21 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-62c8bd24-3268-45f0-9b55-4603845d24a4 req-3f583066-5bea-4896-a961-a2283cd53e21 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-62c8bd24-3268-45f0-9b55-4603845d24a4 req-3f583066-5bea-4896-a961-a2283cd53e21 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:18 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-62c8bd24-3268-45f0-9b55-4603845d24a4 req-3f583066-5bea-4896-a961-a2283cd53e21 service nova] Creating event network-vif-deleted:78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance 68b29390-867e-4bf3-bc93-b401f32b130e on user Apr 12 10:47:18 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-62c8bd24-3268-45f0-9b55-4603845d24a4 req-3f583066-5bea-4896-a961-a2283cd53e21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032034 Apr 12 10:47:18 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 208/609] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:47:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:21 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d88b559e-0d56-46d5-b4f7-582857da9e9c tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:21 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d88b559e-0d56-46d5-b4f7-582857da9e9c tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d88b559e-0d56-46d5-b4f7-582857da9e9c tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d88b559e-0d56-46d5-b4f7-582857da9e9c tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d88b559e-0d56-46d5-b4f7-582857da9e9c tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d88b559e-0d56-46d5-b4f7-582857da9e9c tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d88b559e-0d56-46d5-b4f7-582857da9e9c tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d88b559e-0d56-46d5-b4f7-582857da9e9c tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:21 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-d88b559e-0d56-46d5-b4f7-582857da9e9c tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:47:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-d88b559e-0d56-46d5-b4f7-582857da9e9c tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3" status: 200 len: 1581 microversion: 2.1 time: 0.206984 Apr 12 10:47:21 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 200/610] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:47:21 2023] GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3 => generated 1581 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:47:23 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-79a2edbe-5a6e-4c7e-be72-b15b98f6d5e0 req-334dde7b-6f6e-43b2-9392-d371076ffdd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d687131b-6853-4d65-b8f7-ecef019ae9f3", "tag": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-79a2edbe-5a6e-4c7e-be72-b15b98f6d5e0 req-334dde7b-6f6e-43b2-9392-d371076ffdd9 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-79a2edbe-5a6e-4c7e-be72-b15b98f6d5e0 req-334dde7b-6f6e-43b2-9392-d371076ffdd9 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-79a2edbe-5a6e-4c7e-be72-b15b98f6d5e0 req-334dde7b-6f6e-43b2-9392-d371076ffdd9 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:23 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-79a2edbe-5a6e-4c7e-be72-b15b98f6d5e0 req-334dde7b-6f6e-43b2-9392-d371076ffdd9 service nova] Creating event network-changed:04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance d687131b-6853-4d65-b8f7-ecef019ae9f3 on user Apr 12 10:47:23 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-79a2edbe-5a6e-4c7e-be72-b15b98f6d5e0 req-334dde7b-6f6e-43b2-9392-d371076ffdd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036040 Apr 12 10:47:23 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 203/611] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:47:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-1c6db142-1282-45de-829d-c88513ca1c11 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1945078419"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:24 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-1c6db142-1282-45de-829d-c88513ca1c11 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1c6db142-1282-45de-829d-c88513ca1c11 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1c6db142-1282-45de-829d-c88513ca1c11 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1c6db142-1282-45de-829d-c88513ca1c11 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1c6db142-1282-45de-829d-c88513ca1c11 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1c6db142-1282-45de-829d-c88513ca1c11 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1c6db142-1282-45de-829d-c88513ca1c11 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:24 user devstack@n-api.service[61854]: INFO nova.network.security_group_api [None req-1c6db142-1282-45de-829d-c88513ca1c11 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Adding security group 6baaf21f-ea17-4fe4-8510-0d6a50c1abc1 to port 04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 Apr 12 10:47:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-1c6db142-1282-45de-829d-c88513ca1c11 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3/action" status: 202 len: 0 microversion: 2.1 time: 0.873932 Apr 12 10:47:25 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 209/612] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:47:24 2023] POST /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3/action => generated 0 bytes in 877 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:47:25 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c7cd9534-3161-4871-95bd-493df76dda15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:25 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c7cd9534-3161-4871-95bd-493df76dda15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:25 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-0dae2ef6-416c-43fe-8a54-00d86b3f7fad req-8f18a4ad-0562-4502-92ba-e4603c49381f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d687131b-6853-4d65-b8f7-ecef019ae9f3", "tag": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7cd9534-3161-4871-95bd-493df76dda15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7cd9534-3161-4871-95bd-493df76dda15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7cd9534-3161-4871-95bd-493df76dda15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7cd9534-3161-4871-95bd-493df76dda15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7cd9534-3161-4871-95bd-493df76dda15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7cd9534-3161-4871-95bd-493df76dda15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-0dae2ef6-416c-43fe-8a54-00d86b3f7fad req-8f18a4ad-0562-4502-92ba-e4603c49381f service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:25 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=27 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:47:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-0dae2ef6-416c-43fe-8a54-00d86b3f7fad req-8f18a4ad-0562-4502-92ba-e4603c49381f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-0dae2ef6-416c-43fe-8a54-00d86b3f7fad req-8f18a4ad-0562-4502-92ba-e4603c49381f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-0dae2ef6-416c-43fe-8a54-00d86b3f7fad req-8f18a4ad-0562-4502-92ba-e4603c49381f service nova] Creating event network-changed:04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance d687131b-6853-4d65-b8f7-ecef019ae9f3 on user Apr 12 10:47:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-0dae2ef6-416c-43fe-8a54-00d86b3f7fad req-8f18a4ad-0562-4502-92ba-e4603c49381f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056512 Apr 12 10:47:25 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 204/613] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:47:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:25 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-c7cd9534-3161-4871-95bd-493df76dda15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:47:25 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c7cd9534-3161-4871-95bd-493df76dda15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3" status: 200 len: 1747 microversion: 2.1 time: 0.458448 Apr 12 10:47:25 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 201/614] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:47:25 2023] GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3 => generated 1747 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:47:28 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:28 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:28 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:28 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3/action" status: 202 len: 0 microversion: 2.1 time: 0.095895 Apr 12 10:47:28 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 210/615] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:47:28 2023] POST /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:47:28 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-53146f6e-d30b-41f3-8c64-d611e3b64115 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:28 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-53146f6e-d30b-41f3-8c64-d611e3b64115 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-53146f6e-d30b-41f3-8c64-d611e3b64115 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-53146f6e-d30b-41f3-8c64-d611e3b64115 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-53146f6e-d30b-41f3-8c64-d611e3b64115 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-53146f6e-d30b-41f3-8c64-d611e3b64115 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-53146f6e-d30b-41f3-8c64-d611e3b64115 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-53146f6e-d30b-41f3-8c64-d611e3b64115 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:28 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-53146f6e-d30b-41f3-8c64-d611e3b64115 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:47:28 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-53146f6e-d30b-41f3-8c64-d611e3b64115 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3" status: 200 len: 1749 microversion: 2.1 time: 0.171345 Apr 12 10:47:28 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 205/616] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:47:28 2023] GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3 => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:47:29 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-d17519b3-f3f1-487b-94ef-fd9f04708f25 req-fcc06f07-06d5-4ce1-a8cf-5b2857bff129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d687131b-6853-4d65-b8f7-ecef019ae9f3", "name": "network-vif-unplugged", "status": "completed", "tag": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d17519b3-f3f1-487b-94ef-fd9f04708f25 req-fcc06f07-06d5-4ce1-a8cf-5b2857bff129 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d17519b3-f3f1-487b-94ef-fd9f04708f25 req-fcc06f07-06d5-4ce1-a8cf-5b2857bff129 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d17519b3-f3f1-487b-94ef-fd9f04708f25 req-fcc06f07-06d5-4ce1-a8cf-5b2857bff129 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-d17519b3-f3f1-487b-94ef-fd9f04708f25 req-fcc06f07-06d5-4ce1-a8cf-5b2857bff129 service nova] Creating event network-vif-unplugged:04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance d687131b-6853-4d65-b8f7-ecef019ae9f3 on user Apr 12 10:47:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-d17519b3-f3f1-487b-94ef-fd9f04708f25 req-fcc06f07-06d5-4ce1-a8cf-5b2857bff129 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033304 Apr 12 10:47:29 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 202/617] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:47:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:31 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-06e999a0-a222-4899-8a95-1026720f568b req-9324ba4d-56a6-40f9-bfe5-8e8d82d1a196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d687131b-6853-4d65-b8f7-ecef019ae9f3", "name": "network-vif-plugged", "status": "completed", "tag": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-06e999a0-a222-4899-8a95-1026720f568b req-9324ba4d-56a6-40f9-bfe5-8e8d82d1a196 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-06e999a0-a222-4899-8a95-1026720f568b req-9324ba4d-56a6-40f9-bfe5-8e8d82d1a196 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:31 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-06e999a0-a222-4899-8a95-1026720f568b req-9324ba4d-56a6-40f9-bfe5-8e8d82d1a196 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-06e999a0-a222-4899-8a95-1026720f568b req-9324ba4d-56a6-40f9-bfe5-8e8d82d1a196 service nova] Creating event network-vif-plugged:04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance d687131b-6853-4d65-b8f7-ecef019ae9f3 on user Apr 12 10:47:31 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-06e999a0-a222-4899-8a95-1026720f568b req-9324ba4d-56a6-40f9-bfe5-8e8d82d1a196 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030157 Apr 12 10:47:31 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 211/618] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:47:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:32 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-33ee5e40-d7a2-4989-9ef2-4c1559e22cdd tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:32 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-33ee5e40-d7a2-4989-9ef2-4c1559e22cdd tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-33ee5e40-d7a2-4989-9ef2-4c1559e22cdd tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-33ee5e40-d7a2-4989-9ef2-4c1559e22cdd tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-33ee5e40-d7a2-4989-9ef2-4c1559e22cdd tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-33ee5e40-d7a2-4989-9ef2-4c1559e22cdd tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-33ee5e40-d7a2-4989-9ef2-4c1559e22cdd tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-33ee5e40-d7a2-4989-9ef2-4c1559e22cdd tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:32 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-33ee5e40-d7a2-4989-9ef2-4c1559e22cdd tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] HTTP exception thrown: Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 could not be found. Apr 12 10:47:32 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-33ee5e40-d7a2-4989-9ef2-4c1559e22cdd tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Request method failure captured: Apr 12 10:47:32 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44 HTTP/1.1 Apr 12 10:47:32 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:47:32 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:47:32 user devstack@n-api.service[61852]: Connection: close Apr 12 10:47:32 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:47:32 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:47:32 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:47:32 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:47:32 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:47:32 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNosjxmxcVjmUpCMLAxdRdLndUlKxh4MkCcirUvRtNoND63IGb1xoGABQC8D9rLRE4dW_L0z2oNcBU8jtABVmL5XlYtTU15Uvd1NUbrH9hi6BA13fINZDRHpVQlP0DCe8J969vT87xyN1x_qfcLnOr5CvtvwcJHsWkRykm4XG-p9tMms Apr 12 10:47:32 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:47:32 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:47:32 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:47:32 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:47:32 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:47:32 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:47:32 user devstack@n-api.service[61852]: X-Project-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:47:32 user devstack@n-api.service[61852]: X-Project-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:47:32 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:47:32 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:47:32 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:47:32 user devstack@n-api.service[61852]: X-Tenant: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:47:32 user devstack@n-api.service[61852]: X-Tenant-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:47:32 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:47:32 user devstack@n-api.service[61852]: X-User: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:47:32 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:47:32 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:47:32 user devstack@n-api.service[61852]: X-User-Id: 7ec47d3cdacb45e5a39509e76b546e34 Apr 12 10:47:32 user devstack@n-api.service[61852]: X-User-Name: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:47:32 user devstack@n-api.service[61852]: method: > Apr 12 10:47:32 user devstack@n-api.service[61852]: exception: Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 could not be found. Apr 12 10:47:32 user devstack@n-api.service[61852]: action_args: {'id': '979fbc15-1dd0-46b8-a9c4-54be9d93da44'} Apr 12 10:47:32 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 could not be found. Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 could not be found. Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 could not be found. Apr 12 10:47:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:47:32 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-33ee5e40-d7a2-4989-9ef2-4c1559e22cdd tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Returning 404 to user: Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:47:32 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-33ee5e40-d7a2-4989-9ef2-4c1559e22cdd tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44" status: 404 len: 111 microversion: 2.1 time: 0.030688 Apr 12 10:47:32 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 206/619] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:47:32 2023] GET /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:47:32 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-bbfdb08c-0b7d-430b-adef-0ac392346e94 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '.version_select at 0x7fabbf64eef0>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:32 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-bbfdb08c-0b7d-430b-adef-0ac392346e94 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-615324409" status: 202 len: 0 microversion: 2.1 time: 0.026047 Apr 12 10:47:32 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 203/620] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 10:47:32 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-615324409 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:47:32 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:32 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:33 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'services' on Instance uuid 4b79f4d7-f34e-4971-8a6f-171c2d71d683 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:47:33 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683/os-volume_attachments/520ed03a-e80e-4bc4-afed-57601fa90711" status: 202 len: 0 microversion: 2.1 time: 0.180644 Apr 12 10:47:33 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 212/621] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 10:47:32 2023] DELETE /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683/os-volume_attachments/520ed03a-e80e-4bc4-afed-57601fa90711 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:47:33 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-9fbfd155-4188-4225-b923-80502295717b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:33 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-9fbfd155-4188-4225-b923-80502295717b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:33 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9fbfd155-4188-4225-b923-80502295717b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:33 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9fbfd155-4188-4225-b923-80502295717b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:33 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9fbfd155-4188-4225-b923-80502295717b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:33 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9fbfd155-4188-4225-b923-80502295717b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:33 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9fbfd155-4188-4225-b923-80502295717b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:33 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9fbfd155-4188-4225-b923-80502295717b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:33 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-9fbfd155-4188-4225-b923-80502295717b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052242 Apr 12 10:47:33 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 207/622] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:47:33 2023] GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:34 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-8ca7fe0b-d181-466e-a9ad-bfde6c4499de req-3ab3815e-7c6a-48f6-a067-669ac7c9cc8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d687131b-6853-4d65-b8f7-ecef019ae9f3", "name": "network-vif-plugged", "status": "completed", "tag": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8ca7fe0b-d181-466e-a9ad-bfde6c4499de req-3ab3815e-7c6a-48f6-a067-669ac7c9cc8a service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:34 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'flavor' on Instance uuid be3f67e5-420d-42a2-b68a-7cadff22fa48 {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:47:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8ca7fe0b-d181-466e-a9ad-bfde6c4499de req-3ab3815e-7c6a-48f6-a067-669ac7c9cc8a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8ca7fe0b-d181-466e-a9ad-bfde6c4499de req-3ab3815e-7c6a-48f6-a067-669ac7c9cc8a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-8ca7fe0b-d181-466e-a9ad-bfde6c4499de req-3ab3815e-7c6a-48f6-a067-669ac7c9cc8a service nova] Creating event network-vif-plugged:04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance d687131b-6853-4d65-b8f7-ecef019ae9f3 on user Apr 12 10:47:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-8ca7fe0b-d181-466e-a9ad-bfde6c4499de req-3ab3815e-7c6a-48f6-a067-669ac7c9cc8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035953 Apr 12 10:47:34 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 213/623] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:47:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "POST /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48/action" status: 200 len: 32 microversion: 2.1 time: 0.228166 Apr 12 10:47:35 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 204/624] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:47:34 2023] POST /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 10:47:35 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-8bf2a548-945e-4cfb-a14c-1643822998b6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:35 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-8bf2a548-945e-4cfb-a14c-1643822998b6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8bf2a548-945e-4cfb-a14c-1643822998b6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8bf2a548-945e-4cfb-a14c-1643822998b6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8bf2a548-945e-4cfb-a14c-1643822998b6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8bf2a548-945e-4cfb-a14c-1643822998b6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8bf2a548-945e-4cfb-a14c-1643822998b6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8bf2a548-945e-4cfb-a14c-1643822998b6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:35 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-8bf2a548-945e-4cfb-a14c-1643822998b6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:47:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-8bf2a548-945e-4cfb-a14c-1643822998b6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48" status: 200 len: 1510 microversion: 2.1 time: 0.315103 Apr 12 10:47:35 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 208/625] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:47:35 2023] GET /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48 => generated 1510 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:47:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-7e2c59ad-0479-4971-ba9f-482a94add591 req-34bb5c31-2724-4df5-a9f0-bde9589e155e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3f67e5-420d-42a2-b68a-7cadff22fa48", "name": "network-vif-unplugged", "status": "completed", "tag": "943dbed4-3180-4221-b27c-710c0118b7cf"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7e2c59ad-0479-4971-ba9f-482a94add591 req-34bb5c31-2724-4df5-a9f0-bde9589e155e service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7e2c59ad-0479-4971-ba9f-482a94add591 req-34bb5c31-2724-4df5-a9f0-bde9589e155e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7e2c59ad-0479-4971-ba9f-482a94add591 req-34bb5c31-2724-4df5-a9f0-bde9589e155e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-7e2c59ad-0479-4971-ba9f-482a94add591 req-34bb5c31-2724-4df5-a9f0-bde9589e155e service nova] Creating event network-vif-unplugged:943dbed4-3180-4221-b27c-710c0118b7cf for instance be3f67e5-420d-42a2-b68a-7cadff22fa48 on user Apr 12 10:47:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-7e2c59ad-0479-4971-ba9f-482a94add591 req-34bb5c31-2724-4df5-a9f0-bde9589e155e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035999 Apr 12 10:47:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 214/626] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:47:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:36 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-deb9f6a7-f668-4311-87af-77e3d91951ca req-bc66af3d-0ba8-4388-bc3f-31d2c46fe13e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d687131b-6853-4d65-b8f7-ecef019ae9f3", "name": "network-vif-plugged", "status": "completed", "tag": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-deb9f6a7-f668-4311-87af-77e3d91951ca req-bc66af3d-0ba8-4388-bc3f-31d2c46fe13e service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-deb9f6a7-f668-4311-87af-77e3d91951ca req-bc66af3d-0ba8-4388-bc3f-31d2c46fe13e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-deb9f6a7-f668-4311-87af-77e3d91951ca req-bc66af3d-0ba8-4388-bc3f-31d2c46fe13e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-deb9f6a7-f668-4311-87af-77e3d91951ca req-bc66af3d-0ba8-4388-bc3f-31d2c46fe13e service nova] Creating event network-vif-plugged:04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance d687131b-6853-4d65-b8f7-ecef019ae9f3 on user Apr 12 10:47:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-deb9f6a7-f668-4311-87af-77e3d91951ca req-bc66af3d-0ba8-4388-bc3f-31d2c46fe13e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029782 Apr 12 10:47:36 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 205/627] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:47:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:37 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-795e2f1e-a3d9-4a9c-ad0c-b74a94f1b78b req-5e44a633-a2d7-4468-b30a-7db367e9e136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3f67e5-420d-42a2-b68a-7cadff22fa48", "name": "network-vif-plugged", "status": "completed", "tag": "943dbed4-3180-4221-b27c-710c0118b7cf"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:37 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:47:37 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-795e2f1e-a3d9-4a9c-ad0c-b74a94f1b78b req-5e44a633-a2d7-4468-b30a-7db367e9e136 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:37 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-795e2f1e-a3d9-4a9c-ad0c-b74a94f1b78b req-5e44a633-a2d7-4468-b30a-7db367e9e136 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:37 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-795e2f1e-a3d9-4a9c-ad0c-b74a94f1b78b req-5e44a633-a2d7-4468-b30a-7db367e9e136 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:37 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:47:37 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-795e2f1e-a3d9-4a9c-ad0c-b74a94f1b78b req-5e44a633-a2d7-4468-b30a-7db367e9e136 service nova] Creating event network-vif-plugged:943dbed4-3180-4221-b27c-710c0118b7cf for instance be3f67e5-420d-42a2-b68a-7cadff22fa48 on user Apr 12 10:47:37 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-795e2f1e-a3d9-4a9c-ad0c-b74a94f1b78b req-5e44a633-a2d7-4468-b30a-7db367e9e136 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032378 Apr 12 10:47:37 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 209/628] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:47:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:39 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3f67e5-420d-42a2-b68a-7cadff22fa48", "name": "network-vif-plugged", "status": "completed", "tag": "943dbed4-3180-4221-b27c-710c0118b7cf"}, {"server_uuid": "be3f67e5-420d-42a2-b68a-7cadff22fa48", "name": "network-vif-plugged", "status": "completed", "tag": "943dbed4-3180-4221-b27c-710c0118b7cf"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:39 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=23 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:47:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:39 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:47:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] Creating event network-vif-plugged:943dbed4-3180-4221-b27c-710c0118b7cf for instance be3f67e5-420d-42a2-b68a-7cadff22fa48 on user Apr 12 10:47:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] Creating event network-vif-plugged:943dbed4-3180-4221-b27c-710c0118b7cf for instance be3f67e5-420d-42a2-b68a-7cadff22fa48 on user Apr 12 10:47:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051493 Apr 12 10:47:40 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 215/629] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:47:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:44 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ac40f81e-dc25-4e4e-b192-eb98ac8311ff tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:44 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-ac40f81e-dc25-4e4e-b192-eb98ac8311ff tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:44 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:47:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ac40f81e-dc25-4e4e-b192-eb98ac8311ff tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ac40f81e-dc25-4e4e-b192-eb98ac8311ff tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ac40f81e-dc25-4e4e-b192-eb98ac8311ff tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ac40f81e-dc25-4e4e-b192-eb98ac8311ff tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ac40f81e-dc25-4e4e-b192-eb98ac8311ff tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ac40f81e-dc25-4e4e-b192-eb98ac8311ff tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:44 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-ac40f81e-dc25-4e4e-b192-eb98ac8311ff tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:47:44 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-ac40f81e-dc25-4e4e-b192-eb98ac8311ff tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:47:44 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-ac40f81e-dc25-4e4e-b192-eb98ac8311ff tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:47:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-ac40f81e-dc25-4e4e-b192-eb98ac8311ff tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" status: 200 len: 1767 microversion: 2.87 time: 0.385554 Apr 12 10:47:44 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 206/630] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:47:44 2023] GET /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa => generated 1767 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:47:53 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-4392c8c6-977e-443c-b89f-7d743443e0c2 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:53 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-4392c8c6-977e-443c-b89f-7d743443e0c2 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4392c8c6-977e-443c-b89f-7d743443e0c2 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4392c8c6-977e-443c-b89f-7d743443e0c2 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4392c8c6-977e-443c-b89f-7d743443e0c2 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4392c8c6-977e-443c-b89f-7d743443e0c2 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4392c8c6-977e-443c-b89f-7d743443e0c2 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4392c8c6-977e-443c-b89f-7d743443e0c2 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:53 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-4392c8c6-977e-443c-b89f-7d743443e0c2 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.086089 Apr 12 10:47:53 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 210/631] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 10:47:53 2023] GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34/os-interface => generated 283 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:47:54 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:47:54 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-2acc909c-ccc3-4696-a635-eb4850fd978e req-c9f0d638-4000-4cdd-8aab-089285f88247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76758da6-ef8f-433f-b4e8-8d72f01b6b34", "tag": "65d96800-cdfa-49fe-a407-05d5b661f452"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2acc909c-ccc3-4696-a635-eb4850fd978e req-c9f0d638-4000-4cdd-8aab-089285f88247 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2acc909c-ccc3-4696-a635-eb4850fd978e req-c9f0d638-4000-4cdd-8aab-089285f88247 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-2acc909c-ccc3-4696-a635-eb4850fd978e req-c9f0d638-4000-4cdd-8aab-089285f88247 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-2acc909c-ccc3-4696-a635-eb4850fd978e req-c9f0d638-4000-4cdd-8aab-089285f88247 service nova] Creating event network-changed:65d96800-cdfa-49fe-a407-05d5b661f452 for instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 on user Apr 12 10:47:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-2acc909c-ccc3-4696-a635-eb4850fd978e req-c9f0d638-4000-4cdd-8aab-089285f88247 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038308 Apr 12 10:47:54 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 216/632] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:47:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:54 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-71e649ad-975d-4847-b421-f5caf6593b54 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:54 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-71e649ad-975d-4847-b421-f5caf6593b54 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:54 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:47:54 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:47:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-71e649ad-975d-4847-b421-f5caf6593b54 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-71e649ad-975d-4847-b421-f5caf6593b54 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-71e649ad-975d-4847-b421-f5caf6593b54 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-71e649ad-975d-4847-b421-f5caf6593b54 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-71e649ad-975d-4847-b421-f5caf6593b54 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-71e649ad-975d-4847-b421-f5caf6593b54 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:54 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-71e649ad-975d-4847-b421-f5caf6593b54 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34/ips" status: 200 len: 110 microversion: 2.20 time: 0.055690 Apr 12 10:47:54 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 207/633] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 12 10:47:54 2023] GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34/ips => generated 110 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:47:56 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:56 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:56 user devstack@n-api.service[61852]: DEBUG nova.objects.instance [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'flavor' on Instance uuid 76758da6-ef8f-433f-b4e8-8d72f01b6b34 {{(pid=61852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:47:56 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "POST /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34/action" status: 202 len: 0 microversion: 2.20 time: 0.816952 Apr 12 10:47:56 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 211/634] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 10:47:56 2023] POST /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34/action => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:47:56 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7df78497-23e3-46b9-812a-80906136829c tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:56 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-7df78497-23e3-46b9-812a-80906136829c tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7df78497-23e3-46b9-812a-80906136829c tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7df78497-23e3-46b9-812a-80906136829c tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7df78497-23e3-46b9-812a-80906136829c tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7df78497-23e3-46b9-812a-80906136829c tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7df78497-23e3-46b9-812a-80906136829c tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7df78497-23e3-46b9-812a-80906136829c tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:57 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-7df78497-23e3-46b9-812a-80906136829c tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:47:57 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-7df78497-23e3-46b9-812a-80906136829c tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:47:57 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-7df78497-23e3-46b9-812a-80906136829c tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:47:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-7df78497-23e3-46b9-812a-80906136829c tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34" status: 200 len: 1710 microversion: 2.20 time: 0.256677 Apr 12 10:47:57 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 217/635] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:47:56 2023] GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34 => generated 1710 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 10:47:57 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-582e0e02-64e3-4433-a0d1-98acb0034220 req-a3b3b8a0-5aca-4575-abd8-472edd18ca21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76758da6-ef8f-433f-b4e8-8d72f01b6b34", "name": "network-vif-unplugged", "status": "completed", "tag": "65d96800-cdfa-49fe-a407-05d5b661f452"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-582e0e02-64e3-4433-a0d1-98acb0034220 req-a3b3b8a0-5aca-4575-abd8-472edd18ca21 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-582e0e02-64e3-4433-a0d1-98acb0034220 req-a3b3b8a0-5aca-4575-abd8-472edd18ca21 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-582e0e02-64e3-4433-a0d1-98acb0034220 req-a3b3b8a0-5aca-4575-abd8-472edd18ca21 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:57 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-582e0e02-64e3-4433-a0d1-98acb0034220 req-a3b3b8a0-5aca-4575-abd8-472edd18ca21 service nova] Creating event network-vif-unplugged:65d96800-cdfa-49fe-a407-05d5b661f452 for instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 on user Apr 12 10:47:57 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-582e0e02-64e3-4433-a0d1-98acb0034220 req-a3b3b8a0-5aca-4575-abd8-472edd18ca21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032283 Apr 12 10:47:57 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 208/636] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:47:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:59 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-2a7a8339-70f2-40d1-b948-89aa3017177d req-86291f2c-6c39-4a42-8970-336d8fcdb7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76758da6-ef8f-433f-b4e8-8d72f01b6b34", "name": "network-vif-plugged", "status": "completed", "tag": "65d96800-cdfa-49fe-a407-05d5b661f452"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:47:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-2a7a8339-70f2-40d1-b948-89aa3017177d req-86291f2c-6c39-4a42-8970-336d8fcdb7d6 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-2a7a8339-70f2-40d1-b948-89aa3017177d req-86291f2c-6c39-4a42-8970-336d8fcdb7d6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-2a7a8339-70f2-40d1-b948-89aa3017177d req-86291f2c-6c39-4a42-8970-336d8fcdb7d6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:59 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-2a7a8339-70f2-40d1-b948-89aa3017177d req-86291f2c-6c39-4a42-8970-336d8fcdb7d6 service nova] Creating event network-vif-plugged:65d96800-cdfa-49fe-a407-05d5b661f452 for instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 on user Apr 12 10:47:59 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-2a7a8339-70f2-40d1-b948-89aa3017177d req-86291f2c-6c39-4a42-8970-336d8fcdb7d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028399 Apr 12 10:47:59 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 212/637] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:47:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:47:59 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b20e053e-2b52-4e79-b81e-3161c8cda5e9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:59 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-b20e053e-2b52-4e79-b81e-3161c8cda5e9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b20e053e-2b52-4e79-b81e-3161c8cda5e9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b20e053e-2b52-4e79-b81e-3161c8cda5e9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b20e053e-2b52-4e79-b81e-3161c8cda5e9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b20e053e-2b52-4e79-b81e-3161c8cda5e9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b20e053e-2b52-4e79-b81e-3161c8cda5e9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b20e053e-2b52-4e79-b81e-3161c8cda5e9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:59 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-b20e053e-2b52-4e79-b81e-3161c8cda5e9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:47:59 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b20e053e-2b52-4e79-b81e-3161c8cda5e9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1723 microversion: 2.1 time: 0.159915 Apr 12 10:47:59 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 218/638] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:47:59 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:47:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a41ce6fe-6037-4cb9-8ffe-9c7584601c1e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:47:59 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a41ce6fe-6037-4cb9-8ffe-9c7584601c1e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:47:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a41ce6fe-6037-4cb9-8ffe-9c7584601c1e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a41ce6fe-6037-4cb9-8ffe-9c7584601c1e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a41ce6fe-6037-4cb9-8ffe-9c7584601c1e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a41ce6fe-6037-4cb9-8ffe-9c7584601c1e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:47:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a41ce6fe-6037-4cb9-8ffe-9c7584601c1e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:47:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a41ce6fe-6037-4cb9-8ffe-9c7584601c1e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:47:59 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-a41ce6fe-6037-4cb9-8ffe-9c7584601c1e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:47:59 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a41ce6fe-6037-4cb9-8ffe-9c7584601c1e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1723 microversion: 2.1 time: 0.189961 Apr 12 10:47:59 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 209/639] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:47:59 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:48:01 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-d7c79d9f-ca5e-45da-8665-954a91caf50a req-5ab1a462-a1cb-48ec-b972-5ec01ce82f71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76758da6-ef8f-433f-b4e8-8d72f01b6b34", "tag": "65d96800-cdfa-49fe-a407-05d5b661f452"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:48:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d7c79d9f-ca5e-45da-8665-954a91caf50a req-5ab1a462-a1cb-48ec-b972-5ec01ce82f71 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d7c79d9f-ca5e-45da-8665-954a91caf50a req-5ab1a462-a1cb-48ec-b972-5ec01ce82f71 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d7c79d9f-ca5e-45da-8665-954a91caf50a req-5ab1a462-a1cb-48ec-b972-5ec01ce82f71 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:01 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-d7c79d9f-ca5e-45da-8665-954a91caf50a req-5ab1a462-a1cb-48ec-b972-5ec01ce82f71 service nova] Creating event network-changed:65d96800-cdfa-49fe-a407-05d5b661f452 for instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 on user Apr 12 10:48:02 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-d7c79d9f-ca5e-45da-8665-954a91caf50a req-5ab1a462-a1cb-48ec-b972-5ec01ce82f71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029635 Apr 12 10:48:02 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 213/640] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:48:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:48:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-bbaffc11-9bf7-4d9c-9c7f-ebbe8a70f89f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:48:05 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-bbaffc11-9bf7-4d9c-9c7f-ebbe8a70f89f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:48:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bbaffc11-9bf7-4d9c-9c7f-ebbe8a70f89f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bbaffc11-9bf7-4d9c-9c7f-ebbe8a70f89f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bbaffc11-9bf7-4d9c-9c7f-ebbe8a70f89f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bbaffc11-9bf7-4d9c-9c7f-ebbe8a70f89f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bbaffc11-9bf7-4d9c-9c7f-ebbe8a70f89f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:05 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bbaffc11-9bf7-4d9c-9c7f-ebbe8a70f89f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-bbaffc11-9bf7-4d9c-9c7f-ebbe8a70f89f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] HTTP exception thrown: Instance 68b29390-867e-4bf3-bc93-b401f32b130e could not be found. Apr 12 10:48:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-bbaffc11-9bf7-4d9c-9c7f-ebbe8a70f89f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Request method failure captured: Apr 12 10:48:05 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e HTTP/1.1 Apr 12 10:48:05 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:48:05 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:48:05 user devstack@n-api.service[61854]: Connection: close Apr 12 10:48:05 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:48:05 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:48:05 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:48:05 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:48:05 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:48:05 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNorR70wRA9ata7Gt21pXJ4d8kch-KyeZzK5IC8x8C2P2CfVWczQb494l7CfL4ECUzjGoJgvlNBxo5VMPNPHHuLw4POYTQOZK7wGYr-qQ_ouVWkkpQ0mqIaT-0JYcRK83EnsmjUXlG0bq0n-WsU0cmWPX6-aiVj_SMmNOhljG3LZbrPQ Apr 12 10:48:05 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:48:05 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:48:05 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:48:05 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:48:05 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:48:05 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:48:05 user devstack@n-api.service[61854]: X-Project-Id: 90ef7aa45de34b01a97b6bc5e0acece5 Apr 12 10:48:05 user devstack@n-api.service[61854]: X-Project-Name: tempest-TestShelveInstance-1176962424 Apr 12 10:48:05 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:48:05 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:48:05 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/90ef7aa45de34b01a97b6bc5e0acece5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90ef7aa45de34b01a97b6bc5e0acece5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90ef7aa45de34b01a97b6bc5e0acece5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:48:05 user devstack@n-api.service[61854]: X-Tenant: tempest-TestShelveInstance-1176962424 Apr 12 10:48:05 user devstack@n-api.service[61854]: X-Tenant-Id: 90ef7aa45de34b01a97b6bc5e0acece5 Apr 12 10:48:05 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TestShelveInstance-1176962424 Apr 12 10:48:05 user devstack@n-api.service[61854]: X-User: tempest-TestShelveInstance-1176962424-project-member Apr 12 10:48:05 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:48:05 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:48:05 user devstack@n-api.service[61854]: X-User-Id: 574af27cae41457c9be3d5d50d347b27 Apr 12 10:48:05 user devstack@n-api.service[61854]: X-User-Name: tempest-TestShelveInstance-1176962424-project-member Apr 12 10:48:05 user devstack@n-api.service[61854]: method: > Apr 12 10:48:05 user devstack@n-api.service[61854]: exception: Instance 68b29390-867e-4bf3-bc93-b401f32b130e could not be found. Apr 12 10:48:05 user devstack@n-api.service[61854]: action_args: {'id': '68b29390-867e-4bf3-bc93-b401f32b130e'} Apr 12 10:48:05 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b29390-867e-4bf3-bc93-b401f32b130e could not be found. Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b29390-867e-4bf3-bc93-b401f32b130e could not be found. Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b29390-867e-4bf3-bc93-b401f32b130e could not be found. Apr 12 10:48:05 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:48:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-bbaffc11-9bf7-4d9c-9c7f-ebbe8a70f89f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Returning 404 to user: Instance 68b29390-867e-4bf3-bc93-b401f32b130e could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:48:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-bbaffc11-9bf7-4d9c-9c7f-ebbe8a70f89f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e" status: 404 len: 111 microversion: 2.1 time: 0.032366 Apr 12 10:48:05 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 219/641] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:48:05 2023] GET /compute/v2.1/servers/68b29390-867e-4bf3-bc93-b401f32b130e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:48:05 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-32378dbd-4618-4441-a75f-5678589a4663 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Calling method '.version_select at 0x7fabbf64feb0>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:48:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-32378dbd-4618-4441-a75f-5678589a4663 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-577615131" status: 202 len: 0 microversion: 2.1 time: 0.025788 Apr 12 10:48:05 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 210/642] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 10:48:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-577615131 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=9 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-9cb8f53f-c812-4b47-9141-84a439db428c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-9cb8f53f-c812-4b47-9141-84a439db428c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9cb8f53f-c812-4b47-9141-84a439db428c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9cb8f53f-c812-4b47-9141-84a439db428c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9cb8f53f-c812-4b47-9141-84a439db428c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9cb8f53f-c812-4b47-9141-84a439db428c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9cb8f53f-c812-4b47-9141-84a439db428c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9cb8f53f-c812-4b47-9141-84a439db428c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-9cb8f53f-c812-4b47-9141-84a439db428c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:48:13 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-9cb8f53f-c812-4b47-9141-84a439db428c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec" status: 200 len: 1377 microversion: 2.1 time: 0.177871 Apr 12 10:48:13 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 214/643] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:48:13 2023] GET /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec => generated 1377 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:48:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-052fddf6-00db-4b39-b2b2-3eeb70c1aef3 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:48:13 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-052fddf6-00db-4b39-b2b2-3eeb70c1aef3 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:48:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-052fddf6-00db-4b39-b2b2-3eeb70c1aef3 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-052fddf6-00db-4b39-b2b2-3eeb70c1aef3 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-052fddf6-00db-4b39-b2b2-3eeb70c1aef3 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-052fddf6-00db-4b39-b2b2-3eeb70c1aef3 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-052fddf6-00db-4b39-b2b2-3eeb70c1aef3 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-052fddf6-00db-4b39-b2b2-3eeb70c1aef3 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:13 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-052fddf6-00db-4b39-b2b2-3eeb70c1aef3 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:48:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-052fddf6-00db-4b39-b2b2-3eeb70c1aef3 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec" status: 200 len: 1377 microversion: 2.1 time: 0.153270 Apr 12 10:48:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 220/644] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:48:13 2023] GET /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec => generated 1377 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:48:13 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:48:13 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:48:13 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=12 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:48:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:13 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:48:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec" status: 204 len: 0 microversion: 2.1 time: 0.130593 Apr 12 10:48:13 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 211/645] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:48:13 2023] DELETE /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-a57d5cf2-6f2e-4cef-bc28-57264376a286 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-a57d5cf2-6f2e-4cef-bc28-57264376a286 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a57d5cf2-6f2e-4cef-bc28-57264376a286 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a57d5cf2-6f2e-4cef-bc28-57264376a286 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a57d5cf2-6f2e-4cef-bc28-57264376a286 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a57d5cf2-6f2e-4cef-bc28-57264376a286 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a57d5cf2-6f2e-4cef-bc28-57264376a286 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a57d5cf2-6f2e-4cef-bc28-57264376a286 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:13 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-a57d5cf2-6f2e-4cef-bc28-57264376a286 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:48:13 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-a57d5cf2-6f2e-4cef-bc28-57264376a286 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec" status: 200 len: 1383 microversion: 2.1 time: 0.220426 Apr 12 10:48:13 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 215/646] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:48:13 2023] GET /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec => generated 1383 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:48:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-63e053f6-33cf-46af-abe8-1df296947302 req-db31c859-6b2a-4f4c-959c-f431ddd8b897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5a8d3c-a65a-4a05-9874-ad22b597ddec", "name": "network-vif-unplugged", "status": "completed", "tag": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:48:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-63e053f6-33cf-46af-abe8-1df296947302 req-db31c859-6b2a-4f4c-959c-f431ddd8b897 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-63e053f6-33cf-46af-abe8-1df296947302 req-db31c859-6b2a-4f4c-959c-f431ddd8b897 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-63e053f6-33cf-46af-abe8-1df296947302 req-db31c859-6b2a-4f4c-959c-f431ddd8b897 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-63e053f6-33cf-46af-abe8-1df296947302 req-db31c859-6b2a-4f4c-959c-f431ddd8b897 service nova] Creating event network-vif-unplugged:363567f1-4d02-4e70-aba9-b7b5c7e2b7ab for instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec on user Apr 12 10:48:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-63e053f6-33cf-46af-abe8-1df296947302 req-db31c859-6b2a-4f4c-959c-f431ddd8b897 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036322 Apr 12 10:48:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 221/647] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:48:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:48:16 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-044ea6fd-6a5a-4d1a-b677-76420155f371 req-9945aa57-19e8-4d35-bcd0-f8903f48d54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5a8d3c-a65a-4a05-9874-ad22b597ddec", "name": "network-vif-plugged", "status": "completed", "tag": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab"}, {"server_uuid": "aa5a8d3c-a65a-4a05-9874-ad22b597ddec", "name": "network-vif-deleted", "tag": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:48:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-044ea6fd-6a5a-4d1a-b677-76420155f371 req-9945aa57-19e8-4d35-bcd0-f8903f48d54b service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-044ea6fd-6a5a-4d1a-b677-76420155f371 req-9945aa57-19e8-4d35-bcd0-f8903f48d54b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:16 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-044ea6fd-6a5a-4d1a-b677-76420155f371 req-9945aa57-19e8-4d35-bcd0-f8903f48d54b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:16 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-044ea6fd-6a5a-4d1a-b677-76420155f371 req-9945aa57-19e8-4d35-bcd0-f8903f48d54b service nova] Creating event network-vif-plugged:363567f1-4d02-4e70-aba9-b7b5c7e2b7ab for instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec on user Apr 12 10:48:16 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-044ea6fd-6a5a-4d1a-b677-76420155f371 req-9945aa57-19e8-4d35-bcd0-f8903f48d54b service nova] Creating event network-vif-deleted:363567f1-4d02-4e70-aba9-b7b5c7e2b7ab for instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec on user Apr 12 10:48:16 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-044ea6fd-6a5a-4d1a-b677-76420155f371 req-9945aa57-19e8-4d35-bcd0-f8903f48d54b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032589 Apr 12 10:48:16 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 212/648] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:48:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:48:18 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-5bd0da33-1ed1-4568-88ad-5eccc16ae401 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:48:18 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-5bd0da33-1ed1-4568-88ad-5eccc16ae401 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:48:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5bd0da33-1ed1-4568-88ad-5eccc16ae401 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5bd0da33-1ed1-4568-88ad-5eccc16ae401 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5bd0da33-1ed1-4568-88ad-5eccc16ae401 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5bd0da33-1ed1-4568-88ad-5eccc16ae401 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5bd0da33-1ed1-4568-88ad-5eccc16ae401 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5bd0da33-1ed1-4568-88ad-5eccc16ae401 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:18 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-5bd0da33-1ed1-4568-88ad-5eccc16ae401 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:48:18 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-5bd0da33-1ed1-4568-88ad-5eccc16ae401 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3" status: 200 len: 1747 microversion: 2.1 time: 0.168946 Apr 12 10:48:18 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 216/649] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:48:18 2023] GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3 => generated 1747 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:48:23 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9221e735-7408-42e9-9fc7-890389ef932b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:48:23 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9221e735-7408-42e9-9fc7-890389ef932b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:48:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9221e735-7408-42e9-9fc7-890389ef932b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9221e735-7408-42e9-9fc7-890389ef932b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9221e735-7408-42e9-9fc7-890389ef932b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9221e735-7408-42e9-9fc7-890389ef932b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9221e735-7408-42e9-9fc7-890389ef932b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9221e735-7408-42e9-9fc7-890389ef932b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9221e735-7408-42e9-9fc7-890389ef932b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.257859 Apr 12 10:48:23 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 222/650] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:48:23 2023] GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683/os-volume_attachments => generated 25 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 10:48:23 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:48:23 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:48:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:23 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:48:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683" status: 204 len: 0 microversion: 2.1 time: 0.118460 Apr 12 10:48:23 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 213/651] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:48:23 2023] DELETE /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:48:23 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-734b8353-2801-4e49-b8b7-238ec5d9986e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:48:23 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-734b8353-2801-4e49-b8b7-238ec5d9986e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:48:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-734b8353-2801-4e49-b8b7-238ec5d9986e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-734b8353-2801-4e49-b8b7-238ec5d9986e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-734b8353-2801-4e49-b8b7-238ec5d9986e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-734b8353-2801-4e49-b8b7-238ec5d9986e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-734b8353-2801-4e49-b8b7-238ec5d9986e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-734b8353-2801-4e49-b8b7-238ec5d9986e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:23 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-734b8353-2801-4e49-b8b7-238ec5d9986e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec47d3cdacb45e5a39509e76b546e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cecbfbfd5f42dbb663367f6fbdf3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:48:23 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-734b8353-2801-4e49-b8b7-238ec5d9986e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683" status: 200 len: 1668 microversion: 2.1 time: 0.205977 Apr 12 10:48:23 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 217/652] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:48:23 2023] GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683 => generated 1668 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:48:23 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-9f1c783f-57d7-4e1c-88df-003c947f92b5 req-fce3f0a8-3a57-4b61-bde5-d86f5863df40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b79f4d7-f34e-4971-8a6f-171c2d71d683", "name": "network-vif-unplugged", "status": "completed", "tag": "ac9512bb-5122-4a70-b970-f82605ed0606"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:48:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9f1c783f-57d7-4e1c-88df-003c947f92b5 req-fce3f0a8-3a57-4b61-bde5-d86f5863df40 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9f1c783f-57d7-4e1c-88df-003c947f92b5 req-fce3f0a8-3a57-4b61-bde5-d86f5863df40 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9f1c783f-57d7-4e1c-88df-003c947f92b5 req-fce3f0a8-3a57-4b61-bde5-d86f5863df40 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-9f1c783f-57d7-4e1c-88df-003c947f92b5 req-fce3f0a8-3a57-4b61-bde5-d86f5863df40 service nova] Creating event network-vif-unplugged:ac9512bb-5122-4a70-b970-f82605ed0606 for instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 on user Apr 12 10:48:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-9f1c783f-57d7-4e1c-88df-003c947f92b5 req-fce3f0a8-3a57-4b61-bde5-d86f5863df40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028462 Apr 12 10:48:23 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 223/653] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:48:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:48:25 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-c07e775f-bea2-4cca-bc8b-65b66493f7ca req-fe6d7cb8-deb0-412a-9053-a0b623bebf1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b79f4d7-f34e-4971-8a6f-171c2d71d683", "name": "network-vif-deleted", "tag": "ac9512bb-5122-4a70-b970-f82605ed0606"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:48:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-c07e775f-bea2-4cca-bc8b-65b66493f7ca req-fe6d7cb8-deb0-412a-9053-a0b623bebf1d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-c07e775f-bea2-4cca-bc8b-65b66493f7ca req-fe6d7cb8-deb0-412a-9053-a0b623bebf1d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-c07e775f-bea2-4cca-bc8b-65b66493f7ca req-fe6d7cb8-deb0-412a-9053-a0b623bebf1d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-c07e775f-bea2-4cca-bc8b-65b66493f7ca req-fe6d7cb8-deb0-412a-9053-a0b623bebf1d service nova] Creating event network-vif-deleted:ac9512bb-5122-4a70-b970-f82605ed0606 for instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 on user Apr 12 10:48:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-c07e775f-bea2-4cca-bc8b-65b66493f7ca req-fe6d7cb8-deb0-412a-9053-a0b623bebf1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056067 Apr 12 10:48:25 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 218/654] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:48:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:48:25 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4fe5ae1c-9461-4dfd-a66e-4d1e866911eb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:48:25 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-4fe5ae1c-9461-4dfd-a66e-4d1e866911eb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:48:25 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:48:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4fe5ae1c-9461-4dfd-a66e-4d1e866911eb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4fe5ae1c-9461-4dfd-a66e-4d1e866911eb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4fe5ae1c-9461-4dfd-a66e-4d1e866911eb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4fe5ae1c-9461-4dfd-a66e-4d1e866911eb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4fe5ae1c-9461-4dfd-a66e-4d1e866911eb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4fe5ae1c-9461-4dfd-a66e-4d1e866911eb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:25 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-4fe5ae1c-9461-4dfd-a66e-4d1e866911eb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:48:25 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-4fe5ae1c-9461-4dfd-a66e-4d1e866911eb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48" status: 200 len: 1490 microversion: 2.1 time: 0.471421 Apr 12 10:48:25 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 214/655] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:48:25 2023] GET /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48 => generated 1490 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:48:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-64998ad0-474f-44a4-acb3-126b19509bec req-7eef3025-29b8-45b7-ba2e-9577748e9ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b79f4d7-f34e-4971-8a6f-171c2d71d683", "name": "network-vif-plugged", "status": "completed", "tag": "ac9512bb-5122-4a70-b970-f82605ed0606"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:48:26 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=17 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:48:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-64998ad0-474f-44a4-acb3-126b19509bec req-7eef3025-29b8-45b7-ba2e-9577748e9ad5 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-64998ad0-474f-44a4-acb3-126b19509bec req-7eef3025-29b8-45b7-ba2e-9577748e9ad5 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-64998ad0-474f-44a4-acb3-126b19509bec req-7eef3025-29b8-45b7-ba2e-9577748e9ad5 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:26 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=34 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:48:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-64998ad0-474f-44a4-acb3-126b19509bec req-7eef3025-29b8-45b7-ba2e-9577748e9ad5 service nova] Creating event network-vif-plugged:ac9512bb-5122-4a70-b970-f82605ed0606 for instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 on user Apr 12 10:48:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-64998ad0-474f-44a4-acb3-126b19509bec req-7eef3025-29b8-45b7-ba2e-9577748e9ad5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050889 Apr 12 10:48:26 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 224/656] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:48:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:48:44 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=10 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:48:44 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=26 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:48:44 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "fa426117-53a4-4a92-ae78-36075528e224"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:48:44 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:48:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:44 user devstack@n-api.service[61852]: DEBUG nova.objects.instance [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'flavor' on Instance uuid 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa {{(pid=61852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:48:45 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/action" status: 200 len: 29 microversion: 2.87 time: 0.490608 Apr 12 10:48:45 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 219/657] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 10:48:44 2023] POST /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/action => generated 29 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:48:45 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-907eceb1-d6df-4e4d-b2b5-0daf15f577a6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:48:45 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-907eceb1-d6df-4e4d-b2b5-0daf15f577a6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:48:45 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:48:45 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:48:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-907eceb1-d6df-4e4d-b2b5-0daf15f577a6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-907eceb1-d6df-4e4d-b2b5-0daf15f577a6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-907eceb1-d6df-4e4d-b2b5-0daf15f577a6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-907eceb1-d6df-4e4d-b2b5-0daf15f577a6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-907eceb1-d6df-4e4d-b2b5-0daf15f577a6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:45 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-907eceb1-d6df-4e4d-b2b5-0daf15f577a6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:45 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-907eceb1-d6df-4e4d-b2b5-0daf15f577a6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:48:45 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-907eceb1-d6df-4e4d-b2b5-0daf15f577a6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:48:45 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-907eceb1-d6df-4e4d-b2b5-0daf15f577a6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:48:45 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-907eceb1-d6df-4e4d-b2b5-0daf15f577a6 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" status: 200 len: 1773 microversion: 2.87 time: 0.235127 Apr 12 10:48:45 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 215/658] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:48:45 2023] GET /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa => generated 1773 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:48:46 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:48:46 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:48:46 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-157664c3-32c4-4fe1-89ee-8b95d2b3c206 req-ecde6e0b-ec3d-4a82-bfd4-8e518bc9f0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa", "name": "network-vif-unplugged", "status": "completed", "tag": "48ecbe51-c168-45fd-9029-d5cfa270e5c5"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:48:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-157664c3-32c4-4fe1-89ee-8b95d2b3c206 req-ecde6e0b-ec3d-4a82-bfd4-8e518bc9f0e8 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-157664c3-32c4-4fe1-89ee-8b95d2b3c206 req-ecde6e0b-ec3d-4a82-bfd4-8e518bc9f0e8 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:46 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-157664c3-32c4-4fe1-89ee-8b95d2b3c206 req-ecde6e0b-ec3d-4a82-bfd4-8e518bc9f0e8 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:46 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-157664c3-32c4-4fe1-89ee-8b95d2b3c206 req-ecde6e0b-ec3d-4a82-bfd4-8e518bc9f0e8 service nova] Creating event network-vif-unplugged:48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa on user Apr 12 10:48:46 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-157664c3-32c4-4fe1-89ee-8b95d2b3c206 req-ecde6e0b-ec3d-4a82-bfd4-8e518bc9f0e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037225 Apr 12 10:48:46 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 225/659] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:48:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:48:47 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-cdb8e92c-649f-4ae5-8893-776676d3c4a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:48:47 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-cdb8e92c-649f-4ae5-8893-776676d3c4a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:48:47 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-cdb8e92c-649f-4ae5-8893-776676d3c4a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:47 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-cdb8e92c-649f-4ae5-8893-776676d3c4a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:47 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-cdb8e92c-649f-4ae5-8893-776676d3c4a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:47 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-cdb8e92c-649f-4ae5-8893-776676d3c4a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:47 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-cdb8e92c-649f-4ae5-8893-776676d3c4a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:47 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-cdb8e92c-649f-4ae5-8893-776676d3c4a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:47 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-cdb8e92c-649f-4ae5-8893-776676d3c4a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:48:47 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-cdb8e92c-649f-4ae5-8893-776676d3c4a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:48:47 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-cdb8e92c-649f-4ae5-8893-776676d3c4a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:48:47 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-cdb8e92c-649f-4ae5-8893-776676d3c4a0 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34" status: 200 len: 1651 microversion: 2.20 time: 0.142031 Apr 12 10:48:47 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 220/660] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:48:47 2023] GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34 => generated 1651 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:48:48 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-8d8c9f72-e537-4a8e-80d6-e7332b7fc429 req-dc9463c9-2189-45a5-ad23-9501b2dd6973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa", "name": "network-vif-plugged", "status": "completed", "tag": "48ecbe51-c168-45fd-9029-d5cfa270e5c5"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:48:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8d8c9f72-e537-4a8e-80d6-e7332b7fc429 req-dc9463c9-2189-45a5-ad23-9501b2dd6973 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8d8c9f72-e537-4a8e-80d6-e7332b7fc429 req-dc9463c9-2189-45a5-ad23-9501b2dd6973 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8d8c9f72-e537-4a8e-80d6-e7332b7fc429 req-dc9463c9-2189-45a5-ad23-9501b2dd6973 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:48 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-8d8c9f72-e537-4a8e-80d6-e7332b7fc429 req-dc9463c9-2189-45a5-ad23-9501b2dd6973 service nova] Creating event network-vif-plugged:48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa on user Apr 12 10:48:48 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-8d8c9f72-e537-4a8e-80d6-e7332b7fc429 req-dc9463c9-2189-45a5-ad23-9501b2dd6973 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028185 Apr 12 10:48:48 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 216/661] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:48:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:48:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa", "name": "network-vif-plugged", "status": "completed", "tag": "48ecbe51-c168-45fd-9029-d5cfa270e5c5"}, {"server_uuid": "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa", "name": "network-vif-plugged", "status": "completed", "tag": "48ecbe51-c168-45fd-9029-d5cfa270e5c5"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:48:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] Creating event network-vif-plugged:48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa on user Apr 12 10:48:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] Creating event network-vif-plugged:48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa on user Apr 12 10:48:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099733 Apr 12 10:48:50 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 226/662] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:48:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:48:59 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:48:59 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:48:59 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:48:59 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:48:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:59 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:48:59 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 204 len: 0 microversion: 2.1 time: 0.116863 Apr 12 10:48:59 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 221/663] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:48:59 2023] DELETE /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:48:59 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:48:59 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=8 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:48:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-fdcdccf2-e2aa-44b3-8092-c8d9b335eac5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:48:59 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-fdcdccf2-e2aa-44b3-8092-c8d9b335eac5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:48:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fdcdccf2-e2aa-44b3-8092-c8d9b335eac5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fdcdccf2-e2aa-44b3-8092-c8d9b335eac5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fdcdccf2-e2aa-44b3-8092-c8d9b335eac5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:48:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fdcdccf2-e2aa-44b3-8092-c8d9b335eac5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:48:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fdcdccf2-e2aa-44b3-8092-c8d9b335eac5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:48:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fdcdccf2-e2aa-44b3-8092-c8d9b335eac5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:00 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-fdcdccf2-e2aa-44b3-8092-c8d9b335eac5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:49:00 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-fdcdccf2-e2aa-44b3-8092-c8d9b335eac5 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 200 len: 1729 microversion: 2.1 time: 0.168600 Apr 12 10:49:00 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 217/664] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:48:59 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:49:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-19455340-1390-4862-84b7-bf58843ba362 req-b0819254-e3aa-4f7c-b00e-cdf6c6dc3cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-unplugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-19455340-1390-4862-84b7-bf58843ba362 req-b0819254-e3aa-4f7c-b00e-cdf6c6dc3cc4 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-19455340-1390-4862-84b7-bf58843ba362 req-b0819254-e3aa-4f7c-b00e-cdf6c6dc3cc4 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-19455340-1390-4862-84b7-bf58843ba362 req-b0819254-e3aa-4f7c-b00e-cdf6c6dc3cc4 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-19455340-1390-4862-84b7-bf58843ba362 req-b0819254-e3aa-4f7c-b00e-cdf6c6dc3cc4 service nova] Creating event network-vif-unplugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:49:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-19455340-1390-4862-84b7-bf58843ba362 req-b0819254-e3aa-4f7c-b00e-cdf6c6dc3cc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043359 Apr 12 10:49:00 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 227/665] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:49:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:49:01 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-7353fc6c-3595-4794-baeb-5361af9b0881 req-9f701759-81bf-4d76-8c82-f4a362c1db36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-deleted", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-7353fc6c-3595-4794-baeb-5361af9b0881 req-9f701759-81bf-4d76-8c82-f4a362c1db36 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-7353fc6c-3595-4794-baeb-5361af9b0881 req-9f701759-81bf-4d76-8c82-f4a362c1db36 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-7353fc6c-3595-4794-baeb-5361af9b0881 req-9f701759-81bf-4d76-8c82-f4a362c1db36 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:01 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-7353fc6c-3595-4794-baeb-5361af9b0881 req-9f701759-81bf-4d76-8c82-f4a362c1db36 service nova] Creating event network-vif-deleted:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:49:01 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-7353fc6c-3595-4794-baeb-5361af9b0881 req-9f701759-81bf-4d76-8c82-f4a362c1db36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044051 Apr 12 10:49:01 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 222/666] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:49:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:49:02 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-d73b4d2f-86b8-4d76-ae10-df3ce20ada99 req-491fd0f7-aad6-4ddc-8c86-c8454e078963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b", "name": "network-vif-plugged", "status": "completed", "tag": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d73b4d2f-86b8-4d76-ae10-df3ce20ada99 req-491fd0f7-aad6-4ddc-8c86-c8454e078963 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d73b4d2f-86b8-4d76-ae10-df3ce20ada99 req-491fd0f7-aad6-4ddc-8c86-c8454e078963 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d73b4d2f-86b8-4d76-ae10-df3ce20ada99 req-491fd0f7-aad6-4ddc-8c86-c8454e078963 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-d73b4d2f-86b8-4d76-ae10-df3ce20ada99 req-491fd0f7-aad6-4ddc-8c86-c8454e078963 service nova] Creating event network-vif-plugged:fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b on user Apr 12 10:49:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-d73b4d2f-86b8-4d76-ae10-df3ce20ada99 req-491fd0f7-aad6-4ddc-8c86-c8454e078963 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034432 Apr 12 10:49:02 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 218/667] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:49:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:49:04 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-97b27805-8dfa-4f9f-9ddb-d010cc11d9c8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:49:04 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-97b27805-8dfa-4f9f-9ddb-d010cc11d9c8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-97b27805-8dfa-4f9f-9ddb-d010cc11d9c8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-97b27805-8dfa-4f9f-9ddb-d010cc11d9c8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-97b27805-8dfa-4f9f-9ddb-d010cc11d9c8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-97b27805-8dfa-4f9f-9ddb-d010cc11d9c8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-97b27805-8dfa-4f9f-9ddb-d010cc11d9c8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-97b27805-8dfa-4f9f-9ddb-d010cc11d9c8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-97b27805-8dfa-4f9f-9ddb-d010cc11d9c8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HTTP exception thrown: Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec could not be found. Apr 12 10:49:04 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-97b27805-8dfa-4f9f-9ddb-d010cc11d9c8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Request method failure captured: Apr 12 10:49:04 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec HTTP/1.1 Apr 12 10:49:04 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:49:04 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:49:04 user devstack@n-api.service[61854]: Connection: close Apr 12 10:49:04 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:49:04 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:49:04 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:49:04 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:49:04 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:49:04 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNovxs2Yantu_ODChXuBI9nxlNd7q64TcAdmUtsdyhrTlt2TPQv6HrTQUW80fTGqaBlerbQwCAm7dWKzvWOOjt7pPApBNdqpqIJVLzbKcuxIuQw915erA4Eg80ETTsBe76KDhlSBBUJHZF_I_Yg-BxJFHiVfAbJBMyp551Ap5yqYIsVQ Apr 12 10:49:04 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:49:04 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:49:04 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:49:04 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:49:04 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:49:04 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:49:04 user devstack@n-api.service[61854]: X-Project-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:49:04 user devstack@n-api.service[61854]: X-Project-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:49:04 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:49:04 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:49:04 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:49:04 user devstack@n-api.service[61854]: X-Tenant: tempest-TestVolumeBootPattern-638607559 Apr 12 10:49:04 user devstack@n-api.service[61854]: X-Tenant-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:49:04 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:49:04 user devstack@n-api.service[61854]: X-User: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:49:04 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:49:04 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:49:04 user devstack@n-api.service[61854]: X-User-Id: b914d7ca786f455baf120f98816abffd Apr 12 10:49:04 user devstack@n-api.service[61854]: X-User-Name: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:49:04 user devstack@n-api.service[61854]: method: > Apr 12 10:49:04 user devstack@n-api.service[61854]: exception: Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec could not be found. Apr 12 10:49:04 user devstack@n-api.service[61854]: action_args: {'id': 'aa5a8d3c-a65a-4a05-9874-ad22b597ddec'} Apr 12 10:49:04 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec could not be found. Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec could not be found. Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec could not be found. Apr 12 10:49:04 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:49:04 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-97b27805-8dfa-4f9f-9ddb-d010cc11d9c8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Returning 404 to user: Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:49:04 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-97b27805-8dfa-4f9f-9ddb-d010cc11d9c8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec" status: 404 len: 111 microversion: 2.1 time: 0.041144 Apr 12 10:49:04 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 228/668] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:49:04 2023] GET /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:49:04 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-d41462a5-cc14-433c-ab46-089308107ca5 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:49:04 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-d41462a5-cc14-433c-ab46-089308107ca5 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d41462a5-cc14-433c-ab46-089308107ca5 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d41462a5-cc14-433c-ab46-089308107ca5 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d41462a5-cc14-433c-ab46-089308107ca5 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d41462a5-cc14-433c-ab46-089308107ca5 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d41462a5-cc14-433c-ab46-089308107ca5 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:04 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d41462a5-cc14-433c-ab46-089308107ca5 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:04 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-d41462a5-cc14-433c-ab46-089308107ca5 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HTTP exception thrown: Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec could not be found. Apr 12 10:49:04 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-d41462a5-cc14-433c-ab46-089308107ca5 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Request method failure captured: Apr 12 10:49:04 user devstack@n-api.service[61852]: request: DELETE /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec HTTP/1.1 Apr 12 10:49:04 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:49:04 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:49:04 user devstack@n-api.service[61852]: Connection: close Apr 12 10:49:04 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:49:04 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:49:04 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:49:04 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:49:04 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:49:04 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNovxs2Yantu_ODChXuBI9nxlNd7q64TcAdmUtsdyhrTlt2TPQv6HrTQUW80fTGqaBlerbQwCAm7dWKzvWOOjt7pPApBNdqpqIJVLzbKcuxIuQw915erA4Eg80ETTsBe76KDhlSBBUJHZF_I_Yg-BxJFHiVfAbJBMyp551Ap5yqYIsVQ Apr 12 10:49:04 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:49:04 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:49:04 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:49:04 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:49:04 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:49:04 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:49:04 user devstack@n-api.service[61852]: X-Project-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:49:04 user devstack@n-api.service[61852]: X-Project-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:49:04 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:49:04 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:49:04 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:49:04 user devstack@n-api.service[61852]: X-Tenant: tempest-TestVolumeBootPattern-638607559 Apr 12 10:49:04 user devstack@n-api.service[61852]: X-Tenant-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:49:04 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:49:04 user devstack@n-api.service[61852]: X-User: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:49:04 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:49:04 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:49:04 user devstack@n-api.service[61852]: X-User-Id: b914d7ca786f455baf120f98816abffd Apr 12 10:49:04 user devstack@n-api.service[61852]: X-User-Name: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:49:04 user devstack@n-api.service[61852]: method: > Apr 12 10:49:04 user devstack@n-api.service[61852]: exception: Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec could not be found. Apr 12 10:49:04 user devstack@n-api.service[61852]: action_args: {'id': 'aa5a8d3c-a65a-4a05-9874-ad22b597ddec'} Apr 12 10:49:04 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec could not be found. Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec could not be found. Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec could not be found. Apr 12 10:49:04 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:49:04 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-d41462a5-cc14-433c-ab46-089308107ca5 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Returning 404 to user: Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:49:04 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-d41462a5-cc14-433c-ab46-089308107ca5 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec" status: 404 len: 111 microversion: 2.1 time: 0.028701 Apr 12 10:49:04 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 223/669] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:49:04 2023] DELETE /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:49:04 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7d906b44-f49a-44b4-a3ad-c026ab843495 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:49:04 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-7d906b44-f49a-44b4-a3ad-c026ab843495 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7d906b44-f49a-44b4-a3ad-c026ab843495 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7d906b44-f49a-44b4-a3ad-c026ab843495 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7d906b44-f49a-44b4-a3ad-c026ab843495 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7d906b44-f49a-44b4-a3ad-c026ab843495 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7d906b44-f49a-44b4-a3ad-c026ab843495 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7d906b44-f49a-44b4-a3ad-c026ab843495 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:04 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-7d906b44-f49a-44b4-a3ad-c026ab843495 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HTTP exception thrown: Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec could not be found. Apr 12 10:49:04 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7d906b44-f49a-44b4-a3ad-c026ab843495 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Request method failure captured: Apr 12 10:49:04 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec HTTP/1.1 Apr 12 10:49:04 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:49:04 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:49:04 user devstack@n-api.service[61853]: Connection: close Apr 12 10:49:04 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:49:04 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:49:04 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:49:04 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:49:04 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:49:04 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNovxs2Yantu_ODChXuBI9nxlNd7q64TcAdmUtsdyhrTlt2TPQv6HrTQUW80fTGqaBlerbQwCAm7dWKzvWOOjt7pPApBNdqpqIJVLzbKcuxIuQw915erA4Eg80ETTsBe76KDhlSBBUJHZF_I_Yg-BxJFHiVfAbJBMyp551Ap5yqYIsVQ Apr 12 10:49:04 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:49:04 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:49:04 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:49:04 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:49:04 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:49:04 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:49:04 user devstack@n-api.service[61853]: X-Project-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:49:04 user devstack@n-api.service[61853]: X-Project-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:49:04 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:49:04 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:49:04 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:49:04 user devstack@n-api.service[61853]: X-Tenant: tempest-TestVolumeBootPattern-638607559 Apr 12 10:49:04 user devstack@n-api.service[61853]: X-Tenant-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:49:04 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:49:04 user devstack@n-api.service[61853]: X-User: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:49:04 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:49:04 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:49:04 user devstack@n-api.service[61853]: X-User-Id: b914d7ca786f455baf120f98816abffd Apr 12 10:49:04 user devstack@n-api.service[61853]: X-User-Name: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:49:04 user devstack@n-api.service[61853]: method: > Apr 12 10:49:04 user devstack@n-api.service[61853]: exception: Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec could not be found. Apr 12 10:49:04 user devstack@n-api.service[61853]: action_args: {'id': 'aa5a8d3c-a65a-4a05-9874-ad22b597ddec'} Apr 12 10:49:04 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec could not be found. Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec could not be found. Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec could not be found. Apr 12 10:49:04 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:49:04 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7d906b44-f49a-44b4-a3ad-c026ab843495 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Returning 404 to user: Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:49:04 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-7d906b44-f49a-44b4-a3ad-c026ab843495 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec" status: 404 len: 111 microversion: 2.1 time: 0.030616 Apr 12 10:49:04 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 219/670] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:49:04 2023] GET /compute/v2.1/servers/aa5a8d3c-a65a-4a05-9874-ad22b597ddec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:49:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-236384963", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "87ef4ba7-ac18-4477-a31f-f433c041fda8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "3ecf6069-4851-431c-a1c3-13e94566fa0b"}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:11 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] validate_networks() for [('3ecf6069-4851-431c-a1c3-13e94566fa0b', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:49:11 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:49:11 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:49:11 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:49:11 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:49:11 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:49:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:12 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting quotas for project a67f3d23b8f74a9496d445c7fc75717e. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:49:12 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting quotas for user b914d7ca786f455baf120f98816abffd and project a67f3d23b8f74a9496d445c7fc75717e. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:49:12 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:49:12 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='87ef4ba7-ac18-4477-a31f-f433c041fda8',volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:49:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.840822 Apr 12 10:49:12 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 229/671] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:49:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:49:12 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-896c06db-2dc1-4f92-965d-c65035660026 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:49:12 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-896c06db-2dc1-4f92-965d-c65035660026 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:12 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-896c06db-2dc1-4f92-965d-c65035660026 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:49:12 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-896c06db-2dc1-4f92-965d-c65035660026 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd" status: 200 len: 1065 microversion: 2.1 time: 0.064630 Apr 12 10:49:12 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 224/672] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:49:12 2023] GET /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd => generated 1065 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:49:13 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f476166a-3712-47b0-9bba-74b80b01b820 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:49:13 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f476166a-3712-47b0-9bba-74b80b01b820 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f476166a-3712-47b0-9bba-74b80b01b820 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f476166a-3712-47b0-9bba-74b80b01b820 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f476166a-3712-47b0-9bba-74b80b01b820 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f476166a-3712-47b0-9bba-74b80b01b820 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f476166a-3712-47b0-9bba-74b80b01b820 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f476166a-3712-47b0-9bba-74b80b01b820 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-f476166a-3712-47b0-9bba-74b80b01b820 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] HTTP exception thrown: Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 could not be found. Apr 12 10:49:13 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f476166a-3712-47b0-9bba-74b80b01b820 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Request method failure captured: Apr 12 10:49:13 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683 HTTP/1.1 Apr 12 10:49:13 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:49:13 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:49:13 user devstack@n-api.service[61853]: Connection: close Apr 12 10:49:13 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:49:13 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:49:13 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:49:13 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:49:13 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:49:13 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNosjxmxcVjmUpCMLAxdRdLndUlKxh4MkCcirUvRtNoND63IGb1xoGABQC8D9rLRE4dW_L0z2oNcBU8jtABVmL5XlYtTU15Uvd1NUbrH9hi6BA13fINZDRHpVQlP0DCe8J969vT87xyN1x_qfcLnOr5CvtvwcJHsWkRykm4XG-p9tMms Apr 12 10:49:13 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:49:13 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:49:13 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:49:13 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:49:13 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:49:13 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:49:13 user devstack@n-api.service[61853]: X-Project-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:49:13 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:49:13 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:49:13 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:49:13 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:49:13 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:49:13 user devstack@n-api.service[61853]: X-Tenant-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:49:13 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:49:13 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:49:13 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:49:13 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:49:13 user devstack@n-api.service[61853]: X-User-Id: 7ec47d3cdacb45e5a39509e76b546e34 Apr 12 10:49:13 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:49:13 user devstack@n-api.service[61853]: method: > Apr 12 10:49:13 user devstack@n-api.service[61853]: exception: Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 could not be found. Apr 12 10:49:13 user devstack@n-api.service[61853]: action_args: {'id': '4b79f4d7-f34e-4971-8a6f-171c2d71d683'} Apr 12 10:49:13 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 could not be found. Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 could not be found. Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 could not be found. Apr 12 10:49:13 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:49:13 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f476166a-3712-47b0-9bba-74b80b01b820 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Returning 404 to user: Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:49:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f476166a-3712-47b0-9bba-74b80b01b820 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683" status: 404 len: 111 microversion: 2.1 time: 0.030005 Apr 12 10:49:13 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 220/673] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:49:13 2023] GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:49:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2df5b836-402e-49b5-8467-9f8cb154bb20 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '.version_select at 0x7fabbf6a5fc0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:49:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2df5b836-402e-49b5-8467-9f8cb154bb20 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-427188730" status: 202 len: 0 microversion: 2.1 time: 0.026357 Apr 12 10:49:14 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 230/674] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 10:49:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-427188730 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:49:14 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-19aba34c-4a67-4ff0-be4b-8a7cf0973dec req-b792422b-44ae-4e7f-8886-db23991e7568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b99fe06-9139-4475-aa72-2968a59df0bd", "tag": "d728429a-36b4-4d31-abe3-ef0cd1154866"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:14 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:49:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-19aba34c-4a67-4ff0-be4b-8a7cf0973dec req-b792422b-44ae-4e7f-8886-db23991e7568 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-19aba34c-4a67-4ff0-be4b-8a7cf0973dec req-b792422b-44ae-4e7f-8886-db23991e7568 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-19aba34c-4a67-4ff0-be4b-8a7cf0973dec req-b792422b-44ae-4e7f-8886-db23991e7568 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-19aba34c-4a67-4ff0-be4b-8a7cf0973dec req-b792422b-44ae-4e7f-8886-db23991e7568 service nova] Creating event network-changed:d728429a-36b4-4d31-abe3-ef0cd1154866 for instance 6b99fe06-9139-4475-aa72-2968a59df0bd on user Apr 12 10:49:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-19aba34c-4a67-4ff0-be4b-8a7cf0973dec req-b792422b-44ae-4e7f-8886-db23991e7568 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029844 Apr 12 10:49:14 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 225/675] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:49:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:49:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f470ad1f-b9d2-4fad-b99a-93efce14eed3 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Action: 'create', calling method: .version_select at 0x7fabbf6cf130>, body: {"keypair": {"name": "tempest-keypair-2069030893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKipfguSd7dc4NJvRPPLP31VOCFOeuF+i2FQp2cShiAg0zxOf24SVoQFQ6OqdsaipYiEQ740XRMxTEXtPJg+qH5uXiKhPPFP26qGzR66QmlrdD5/yTInH56PsjbJixwOyA=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:14 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-f470ad1f-b9d2-4fad-b99a-93efce14eed3 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting quotas for project c3cecbfbfd5f42dbb663367f6fbdf3b0. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:49:14 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-f470ad1f-b9d2-4fad-b99a-93efce14eed3 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting quotas for user 7ec47d3cdacb45e5a39509e76b546e34 and project c3cecbfbfd5f42dbb663367f6fbdf3b0. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:49:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f470ad1f-b9d2-4fad-b99a-93efce14eed3 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048977 Apr 12 10:49:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 221/676] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 10:49:14 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1221075217", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0"}], "security_groups": [{"name": "tempest-securitygroup--1314961307"}], "key_name": "tempest-keypair-2069030893", "user_data": "}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] validate_networks() for [('ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=11 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting quotas for project c3cecbfbfd5f42dbb663367f6fbdf3b0. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting quotas for user 7ec47d3cdacb45e5a39509e76b546e34 and project c3cecbfbfd5f42dbb663367f6fbdf3b0. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:49:16 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:49:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.521308 Apr 12 10:49:16 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 231/677] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:49:16 2023] POST /compute/v2.1/servers => generated 400 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:49:16 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-af54a1ec-1eb7-4a2f-bab7-ead50896e562 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:49:16 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-af54a1ec-1eb7-4a2f-bab7-ead50896e562 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:16 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-af54a1ec-1eb7-4a2f-bab7-ead50896e562 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec47d3cdacb45e5a39509e76b546e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cecbfbfd5f42dbb663367f6fbdf3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:49:16 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-af54a1ec-1eb7-4a2f-bab7-ead50896e562 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7" status: 200 len: 1236 microversion: 2.1 time: 0.062618 Apr 12 10:49:16 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 226/678] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:49:16 2023] GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7 => generated 1236 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:49:19 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f80839fb-fda6-408e-add2-f34788176394 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1945078419"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:19 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f80839fb-fda6-408e-add2-f34788176394 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f80839fb-fda6-408e-add2-f34788176394 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f80839fb-fda6-408e-add2-f34788176394 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f80839fb-fda6-408e-add2-f34788176394 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f80839fb-fda6-408e-add2-f34788176394 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f80839fb-fda6-408e-add2-f34788176394 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f80839fb-fda6-408e-add2-f34788176394 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:19 user devstack@n-api.service[61853]: INFO nova.network.security_group_api [None req-f80839fb-fda6-408e-add2-f34788176394 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Removing security group 6baaf21f-ea17-4fe4-8510-0d6a50c1abc1 from port 04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 Apr 12 10:49:19 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-458b8237-2783-443f-8d0f-b975d34de5e2 req-d740d459-cbe8-4d47-8df4-2a78a9e10a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82ea43d4-f2b9-4665-b1c9-412367e2b4d7", "tag": "a41db5a9-2805-455d-b27e-72e11d4f1012"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-458b8237-2783-443f-8d0f-b975d34de5e2 req-d740d459-cbe8-4d47-8df4-2a78a9e10a5e service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-458b8237-2783-443f-8d0f-b975d34de5e2 req-d740d459-cbe8-4d47-8df4-2a78a9e10a5e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-458b8237-2783-443f-8d0f-b975d34de5e2 req-d740d459-cbe8-4d47-8df4-2a78a9e10a5e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:19 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-458b8237-2783-443f-8d0f-b975d34de5e2 req-d740d459-cbe8-4d47-8df4-2a78a9e10a5e service nova] Creating event network-changed:a41db5a9-2805-455d-b27e-72e11d4f1012 for instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 on user Apr 12 10:49:19 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-458b8237-2783-443f-8d0f-b975d34de5e2 req-d740d459-cbe8-4d47-8df4-2a78a9e10a5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031672 Apr 12 10:49:19 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 232/679] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:49:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:49:20 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f80839fb-fda6-408e-add2-f34788176394 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3/action" status: 202 len: 0 microversion: 2.1 time: 1.028024 Apr 12 10:49:20 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 222/680] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:49:19 2023] POST /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3/action => generated 0 bytes in 1029 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:49:20 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-ab9e04ee-c0b7-48d1-a7a2-6d326d530b78 req-1093d879-3b07-4a94-bfa5-e1d6b8142a9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d687131b-6853-4d65-b8f7-ecef019ae9f3", "tag": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-ab9e04ee-c0b7-48d1-a7a2-6d326d530b78 req-1093d879-3b07-4a94-bfa5-e1d6b8142a9a service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-ab9e04ee-c0b7-48d1-a7a2-6d326d530b78 req-1093d879-3b07-4a94-bfa5-e1d6b8142a9a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-ab9e04ee-c0b7-48d1-a7a2-6d326d530b78 req-1093d879-3b07-4a94-bfa5-e1d6b8142a9a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:21 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-ab9e04ee-c0b7-48d1-a7a2-6d326d530b78 req-1093d879-3b07-4a94-bfa5-e1d6b8142a9a service nova] Creating event network-changed:04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance d687131b-6853-4d65-b8f7-ecef019ae9f3 on user Apr 12 10:49:21 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-ab9e04ee-c0b7-48d1-a7a2-6d326d530b78 req-1093d879-3b07-4a94-bfa5-e1d6b8142a9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045146 Apr 12 10:49:21 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 227/681] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:49:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:49:21 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-a5c9ecee-e070-49cb-b21b-80e48d80358e req-8c6daa14-8c8a-488b-8daf-57d116430a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b99fe06-9139-4475-aa72-2968a59df0bd", "name": "network-vif-plugged", "status": "completed", "tag": "d728429a-36b4-4d31-abe3-ef0cd1154866"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:21 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:49:21 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a5c9ecee-e070-49cb-b21b-80e48d80358e req-8c6daa14-8c8a-488b-8daf-57d116430a04 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a5c9ecee-e070-49cb-b21b-80e48d80358e req-8c6daa14-8c8a-488b-8daf-57d116430a04 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a5c9ecee-e070-49cb-b21b-80e48d80358e req-8c6daa14-8c8a-488b-8daf-57d116430a04 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-a5c9ecee-e070-49cb-b21b-80e48d80358e req-8c6daa14-8c8a-488b-8daf-57d116430a04 service nova] Creating event network-vif-plugged:d728429a-36b4-4d31-abe3-ef0cd1154866 for instance 6b99fe06-9139-4475-aa72-2968a59df0bd on user Apr 12 10:49:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-a5c9ecee-e070-49cb-b21b-80e48d80358e req-8c6daa14-8c8a-488b-8daf-57d116430a04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031591 Apr 12 10:49:21 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 233/682] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:49:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:49:21 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'services' on Instance uuid d687131b-6853-4d65-b8f7-ecef019ae9f3 {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:49:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3/os-volume_attachments/28d188bd-314c-45f4-b762-cb2b3be5b226" status: 202 len: 0 microversion: 2.1 time: 0.226269 Apr 12 10:49:21 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 223/683] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 10:49:21 2023] DELETE /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3/os-volume_attachments/28d188bd-314c-45f4-b762-cb2b3be5b226 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:49:21 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-05bd241f-30cc-46bd-acb9-23f9c022e63d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:49:21 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-05bd241f-30cc-46bd-acb9-23f9c022e63d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-05bd241f-30cc-46bd-acb9-23f9c022e63d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-05bd241f-30cc-46bd-acb9-23f9c022e63d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-05bd241f-30cc-46bd-acb9-23f9c022e63d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-05bd241f-30cc-46bd-acb9-23f9c022e63d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-05bd241f-30cc-46bd-acb9-23f9c022e63d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-05bd241f-30cc-46bd-acb9-23f9c022e63d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:21 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-05bd241f-30cc-46bd-acb9-23f9c022e63d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050295 Apr 12 10:49:21 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 228/684] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:49:21 2023] GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:49:21 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-dede1d62-7b8c-4168-94e6-d9b049f544af req-c3aed4e2-0395-4d00-b392-cbc679fc8911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d687131b-6853-4d65-b8f7-ecef019ae9f3", "tag": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-dede1d62-7b8c-4168-94e6-d9b049f544af req-c3aed4e2-0395-4d00-b392-cbc679fc8911 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-dede1d62-7b8c-4168-94e6-d9b049f544af req-c3aed4e2-0395-4d00-b392-cbc679fc8911 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-dede1d62-7b8c-4168-94e6-d9b049f544af req-c3aed4e2-0395-4d00-b392-cbc679fc8911 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-dede1d62-7b8c-4168-94e6-d9b049f544af req-c3aed4e2-0395-4d00-b392-cbc679fc8911 service nova] Creating event network-changed:04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance d687131b-6853-4d65-b8f7-ecef019ae9f3 on user Apr 12 10:49:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-dede1d62-7b8c-4168-94e6-d9b049f544af req-c3aed4e2-0395-4d00-b392-cbc679fc8911 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029556 Apr 12 10:49:21 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 234/685] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:49:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:49:23 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b99fe06-9139-4475-aa72-2968a59df0bd", "name": "network-vif-plugged", "status": "completed", "tag": "d728429a-36b4-4d31-abe3-ef0cd1154866"}, {"server_uuid": "82ea43d4-f2b9-4665-b1c9-412367e2b4d7", "name": "network-vif-plugged", "status": "completed", "tag": "a41db5a9-2805-455d-b27e-72e11d4f1012"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] Creating event network-vif-plugged:d728429a-36b4-4d31-abe3-ef0cd1154866 for instance 6b99fe06-9139-4475-aa72-2968a59df0bd on user Apr 12 10:49:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] Creating event network-vif-plugged:a41db5a9-2805-455d-b27e-72e11d4f1012 for instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 on user Apr 12 10:49:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042057 Apr 12 10:49:23 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 224/686] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:49:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:49:25 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-7098a6c8-eb8e-471e-afa3-13367e9c537d req-93d6b6c3-6615-4fd6-b882-ff4e9d88030e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ea43d4-f2b9-4665-b1c9-412367e2b4d7", "name": "network-vif-plugged", "status": "completed", "tag": "a41db5a9-2805-455d-b27e-72e11d4f1012"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-7098a6c8-eb8e-471e-afa3-13367e9c537d req-93d6b6c3-6615-4fd6-b882-ff4e9d88030e service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-7098a6c8-eb8e-471e-afa3-13367e9c537d req-93d6b6c3-6615-4fd6-b882-ff4e9d88030e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-7098a6c8-eb8e-471e-afa3-13367e9c537d req-93d6b6c3-6615-4fd6-b882-ff4e9d88030e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-7098a6c8-eb8e-471e-afa3-13367e9c537d req-93d6b6c3-6615-4fd6-b882-ff4e9d88030e service nova] Creating event network-vif-plugged:a41db5a9-2805-455d-b27e-72e11d4f1012 for instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 on user Apr 12 10:49:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-7098a6c8-eb8e-471e-afa3-13367e9c537d req-93d6b6c3-6615-4fd6-b882-ff4e9d88030e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053327 Apr 12 10:49:25 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 229/687] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:49:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:49:25 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3fcf4665-b136-4e99-80cd-2489aa78901e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "384ace45-0376-42a4-9e1f-1a2a69dad749"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:25 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-3fcf4665-b136-4e99-80cd-2489aa78901e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3fcf4665-b136-4e99-80cd-2489aa78901e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3fcf4665-b136-4e99-80cd-2489aa78901e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3fcf4665-b136-4e99-80cd-2489aa78901e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3fcf4665-b136-4e99-80cd-2489aa78901e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3fcf4665-b136-4e99-80cd-2489aa78901e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3fcf4665-b136-4e99-80cd-2489aa78901e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-3fcf4665-b136-4e99-80cd-2489aa78901e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] HTTP exception thrown: Cannot 'attach_volume' instance be3f67e5-420d-42a2-b68a-7cadff22fa48 while it is in vm_state rescued Apr 12 10:49:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3fcf4665-b136-4e99-80cd-2489aa78901e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Request method failure captured: Apr 12 10:49:26 user devstack@n-api.service[61854]: request: POST /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48/os-volume_attachments HTTP/1.1 Apr 12 10:49:26 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:49:26 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:49:26 user devstack@n-api.service[61854]: Connection: close Apr 12 10:49:26 user devstack@n-api.service[61854]: Content-Length: 74 Apr 12 10:49:26 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:49:26 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:49:26 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:49:26 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:49:26 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNosqGCy9LHgGo-Yndp_Ix86dPoADuTrnm_RImsbY43eqA9xWhvyiivJnioJ9z9p3RlxFBVMsvx400Bp1v_lrKGOZVyQ8-QQERpwxm8kerR5X4hr_sxNED11I87boYZJQ5SrrIjm9pfsA1H5fYaQPT7mBTJHETLyCcAwgOQ0Bd95rMsc Apr 12 10:49:26 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:49:26 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:49:26 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:49:26 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:49:26 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:49:26 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:49:26 user devstack@n-api.service[61854]: X-Project-Id: 2b39cd8e55b54a86a7784f2934273e20 Apr 12 10:49:26 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1632398833 Apr 12 10:49:26 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:49:26 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:49:26 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2b39cd8e55b54a86a7784f2934273e20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b39cd8e55b54a86a7784f2934273e20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b39cd8e55b54a86a7784f2934273e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:49:26 user devstack@n-api.service[61854]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1632398833 Apr 12 10:49:26 user devstack@n-api.service[61854]: X-Tenant-Id: 2b39cd8e55b54a86a7784f2934273e20 Apr 12 10:49:26 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1632398833 Apr 12 10:49:26 user devstack@n-api.service[61854]: X-User: tempest-ServerRescueNegativeTestJSON-1632398833-project-member Apr 12 10:49:26 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:49:26 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:49:26 user devstack@n-api.service[61854]: X-User-Id: abdf772f2c7341c29159b6f1f2ce7ccb Apr 12 10:49:26 user devstack@n-api.service[61854]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1632398833-project-member Apr 12 10:49:26 user devstack@n-api.service[61854]: Apr 12 10:49:26 user devstack@n-api.service[61854]: {"volumeAttachment": {"volumeId": "384ace45-0376-42a4-9e1f-1a2a69dad749"}} Apr 12 10:49:26 user devstack@n-api.service[61854]: method: > Apr 12 10:49:26 user devstack@n-api.service[61854]: exception: Cannot 'attach_volume' instance be3f67e5-420d-42a2-b68a-7cadff22fa48 while it is in vm_state rescued Apr 12 10:49:26 user devstack@n-api.service[61854]: action_args: {'server_id': 'be3f67e5-420d-42a2-b68a-7cadff22fa48', 'body': {'volumeAttachment': {'volumeId': '384ace45-0376-42a4-9e1f-1a2a69dad749'}}} Apr 12 10:49:26 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance be3f67e5-420d-42a2-b68a-7cadff22fa48 while it is in vm_state rescued Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance be3f67e5-420d-42a2-b68a-7cadff22fa48 while it is in vm_state rescued Apr 12 10:49:26 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:49:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3fcf4665-b136-4e99-80cd-2489aa78901e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Returning 409 to user: Cannot 'attach_volume' instance be3f67e5-420d-42a2-b68a-7cadff22fa48 while it is in vm_state rescued {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:49:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-3fcf4665-b136-4e99-80cd-2489aa78901e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "POST /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.088063 Apr 12 10:49:26 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 235/688] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:49:25 2023] POST /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48/os-volume_attachments => generated 152 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 10:49:26 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-9c83c186-fe90-43da-a206-20e79f78f16d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:26 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-9c83c186-fe90-43da-a206-20e79f78f16d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:26 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:49:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9c83c186-fe90-43da-a206-20e79f78f16d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9c83c186-fe90-43da-a206-20e79f78f16d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9c83c186-fe90-43da-a206-20e79f78f16d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9c83c186-fe90-43da-a206-20e79f78f16d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9c83c186-fe90-43da-a206-20e79f78f16d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9c83c186-fe90-43da-a206-20e79f78f16d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-9c83c186-fe90-43da-a206-20e79f78f16d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "POST /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48/action" status: 202 len: 0 microversion: 2.1 time: 0.146861 Apr 12 10:49:26 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 225/689] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:49:26 2023] POST /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:49:26 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-f5d6c5fe-3a00-4bd6-ab5c-40f51519101e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:49:26 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-f5d6c5fe-3a00-4bd6-ab5c-40f51519101e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5d6c5fe-3a00-4bd6-ab5c-40f51519101e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5d6c5fe-3a00-4bd6-ab5c-40f51519101e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5d6c5fe-3a00-4bd6-ab5c-40f51519101e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5d6c5fe-3a00-4bd6-ab5c-40f51519101e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5d6c5fe-3a00-4bd6-ab5c-40f51519101e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5d6c5fe-3a00-4bd6-ab5c-40f51519101e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:26 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-f5d6c5fe-3a00-4bd6-ab5c-40f51519101e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:49:26 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-f5d6c5fe-3a00-4bd6-ab5c-40f51519101e tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48" status: 200 len: 1498 microversion: 2.1 time: 0.192701 Apr 12 10:49:26 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 230/690] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:49:26 2023] GET /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48 => generated 1498 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:49:27 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-35364e86-aee0-4445-8b97-2625a1b3944c req-02827fb2-d0d6-4281-b36c-726c6c8ef6bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3f67e5-420d-42a2-b68a-7cadff22fa48", "name": "network-vif-unplugged", "status": "completed", "tag": "943dbed4-3180-4221-b27c-710c0118b7cf"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:27 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:49:27 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=12 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:49:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-35364e86-aee0-4445-8b97-2625a1b3944c req-02827fb2-d0d6-4281-b36c-726c6c8ef6bf service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-35364e86-aee0-4445-8b97-2625a1b3944c req-02827fb2-d0d6-4281-b36c-726c6c8ef6bf service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-35364e86-aee0-4445-8b97-2625a1b3944c req-02827fb2-d0d6-4281-b36c-726c6c8ef6bf service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:27 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-35364e86-aee0-4445-8b97-2625a1b3944c req-02827fb2-d0d6-4281-b36c-726c6c8ef6bf service nova] Creating event network-vif-unplugged:943dbed4-3180-4221-b27c-710c0118b7cf for instance be3f67e5-420d-42a2-b68a-7cadff22fa48 on user Apr 12 10:49:27 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-35364e86-aee0-4445-8b97-2625a1b3944c req-02827fb2-d0d6-4281-b36c-726c6c8ef6bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041872 Apr 12 10:49:27 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 236/691] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:49:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:49:29 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3f67e5-420d-42a2-b68a-7cadff22fa48", "name": "network-vif-plugged", "status": "completed", "tag": "943dbed4-3180-4221-b27c-710c0118b7cf"}, {"server_uuid": "be3f67e5-420d-42a2-b68a-7cadff22fa48", "name": "network-vif-plugged", "status": "completed", "tag": "943dbed4-3180-4221-b27c-710c0118b7cf"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] Creating event network-vif-plugged:943dbed4-3180-4221-b27c-710c0118b7cf for instance be3f67e5-420d-42a2-b68a-7cadff22fa48 on user Apr 12 10:49:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] Creating event network-vif-plugged:943dbed4-3180-4221-b27c-710c0118b7cf for instance be3f67e5-420d-42a2-b68a-7cadff22fa48 on user Apr 12 10:49:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042000 Apr 12 10:49:29 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 226/692] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:49:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:49:31 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-261cce98-5a99-4fa1-a5f1-99828e0edb61 req-b1aabb62-5395-4e3a-9751-7fdd4988bed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3f67e5-420d-42a2-b68a-7cadff22fa48", "name": "network-vif-plugged", "status": "completed", "tag": "943dbed4-3180-4221-b27c-710c0118b7cf"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:31 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:49:31 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:49:31 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-261cce98-5a99-4fa1-a5f1-99828e0edb61 req-b1aabb62-5395-4e3a-9751-7fdd4988bed2 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:31 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-261cce98-5a99-4fa1-a5f1-99828e0edb61 req-b1aabb62-5395-4e3a-9751-7fdd4988bed2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:31 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-261cce98-5a99-4fa1-a5f1-99828e0edb61 req-b1aabb62-5395-4e3a-9751-7fdd4988bed2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:31 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-261cce98-5a99-4fa1-a5f1-99828e0edb61 req-b1aabb62-5395-4e3a-9751-7fdd4988bed2 service nova] Creating event network-vif-plugged:943dbed4-3180-4221-b27c-710c0118b7cf for instance be3f67e5-420d-42a2-b68a-7cadff22fa48 on user Apr 12 10:49:31 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-261cce98-5a99-4fa1-a5f1-99828e0edb61 req-b1aabb62-5395-4e3a-9751-7fdd4988bed2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049355 Apr 12 10:49:31 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 231/693] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:49:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:49:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ace2fd07-d0da-4218-831a-f65417778b69 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:49:35 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-ace2fd07-d0da-4218-831a-f65417778b69 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ace2fd07-d0da-4218-831a-f65417778b69 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ace2fd07-d0da-4218-831a-f65417778b69 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ace2fd07-d0da-4218-831a-f65417778b69 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ace2fd07-d0da-4218-831a-f65417778b69 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ace2fd07-d0da-4218-831a-f65417778b69 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ace2fd07-d0da-4218-831a-f65417778b69 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:35 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-ace2fd07-d0da-4218-831a-f65417778b69 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:49:35 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-ace2fd07-d0da-4218-831a-f65417778b69 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:49:35 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-ace2fd07-d0da-4218-831a-f65417778b69 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:49:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ace2fd07-d0da-4218-831a-f65417778b69 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" status: 200 len: 1753 microversion: 2.87 time: 0.266569 Apr 12 10:49:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 237/694] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:49:35 2023] GET /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa => generated 1753 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:49:47 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:49:47 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:49:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-fbeb108b-89a8-4d90-9ad2-2e6e9acb2805 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5aea2e6-c686-409a-bd54-f59b55737e19"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:47 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-fbeb108b-89a8-4d90-9ad2-2e6e9acb2805 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fbeb108b-89a8-4d90-9ad2-2e6e9acb2805 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fbeb108b-89a8-4d90-9ad2-2e6e9acb2805 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fbeb108b-89a8-4d90-9ad2-2e6e9acb2805 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fbeb108b-89a8-4d90-9ad2-2e6e9acb2805 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fbeb108b-89a8-4d90-9ad2-2e6e9acb2805 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-fbeb108b-89a8-4d90-9ad2-2e6e9acb2805 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-fbeb108b-89a8-4d90-9ad2-2e6e9acb2805 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "POST /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.539295 Apr 12 10:49:47 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 227/695] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 10:49:47 2023] POST /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34/os-volume_attachments => generated 188 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:49:48 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=20 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:49:48 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-9d21a005-c852-4d65-b493-394f46e47f4f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:49:48 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-9d21a005-c852-4d65-b493-394f46e47f4f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:48 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9d21a005-c852-4d65-b493-394f46e47f4f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:48 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9d21a005-c852-4d65-b493-394f46e47f4f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:48 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9d21a005-c852-4d65-b493-394f46e47f4f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:48 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9d21a005-c852-4d65-b493-394f46e47f4f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:48 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9d21a005-c852-4d65-b493-394f46e47f4f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:48 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9d21a005-c852-4d65-b493-394f46e47f4f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:48 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-9d21a005-c852-4d65-b493-394f46e47f4f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34/os-volume_attachments/a5aea2e6-c686-409a-bd54-f59b55737e19" status: 202 len: 0 microversion: 2.20 time: 0.239949 Apr 12 10:49:48 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 232/696] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 10:49:48 2023] DELETE /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34/os-volume_attachments/a5aea2e6-c686-409a-bd54-f59b55737e19 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:49:48 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:48 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:48 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=19 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:49:48 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:49:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:48 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61854) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 10:49:48 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "POST /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34/action" status: 202 len: 0 microversion: 2.20 time: 0.139195 Apr 12 10:49:48 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 238/697] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 10:49:48 2023] POST /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:49:48 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-84ff1255-8705-4ee4-a4ec-f92c0eb3862e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:49:48 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-84ff1255-8705-4ee4-a4ec-f92c0eb3862e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-84ff1255-8705-4ee4-a4ec-f92c0eb3862e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-84ff1255-8705-4ee4-a4ec-f92c0eb3862e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-84ff1255-8705-4ee4-a4ec-f92c0eb3862e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-84ff1255-8705-4ee4-a4ec-f92c0eb3862e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-84ff1255-8705-4ee4-a4ec-f92c0eb3862e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-84ff1255-8705-4ee4-a4ec-f92c0eb3862e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:48 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-84ff1255-8705-4ee4-a4ec-f92c0eb3862e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:49:48 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-84ff1255-8705-4ee4-a4ec-f92c0eb3862e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:49:48 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-84ff1255-8705-4ee4-a4ec-f92c0eb3862e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:49:48 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-84ff1255-8705-4ee4-a4ec-f92c0eb3862e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34" status: 200 len: 1659 microversion: 2.20 time: 0.190617 Apr 12 10:49:48 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 228/698] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:49:48 2023] GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34 => generated 1659 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:49:50 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-bc1ec04d-1751-4af0-b914-f2784f21b0e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:49:50 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-bc1ec04d-1751-4af0-b914-f2784f21b0e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-bc1ec04d-1751-4af0-b914-f2784f21b0e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-bc1ec04d-1751-4af0-b914-f2784f21b0e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-bc1ec04d-1751-4af0-b914-f2784f21b0e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-bc1ec04d-1751-4af0-b914-f2784f21b0e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-bc1ec04d-1751-4af0-b914-f2784f21b0e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-bc1ec04d-1751-4af0-b914-f2784f21b0e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:50 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-bc1ec04d-1751-4af0-b914-f2784f21b0e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] HTTP exception thrown: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 10:49:50 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-bc1ec04d-1751-4af0-b914-f2784f21b0e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Request method failure captured: Apr 12 10:49:50 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b HTTP/1.1 Apr 12 10:49:50 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:49:50 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:49:50 user devstack@n-api.service[61852]: Connection: close Apr 12 10:49:50 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:49:50 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:49:50 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:49:50 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:49:50 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:49:50 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNolnZNzT2ThxhSuriBvxuvzWZTym4AlaZYFeuKEGLDsI4JQU5J5EPdqePhYq7aD0VLU4aPMYtUubtPCx4cTyFqrT8VJO6mTH-GETo4CcBCG0ZBRUEmmG4Xqag9VuceySJFT8Zl4MMu3msZfldyluyIaplQmRePuPI9QT24i1FtyI7ZE Apr 12 10:49:50 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:49:50 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:49:50 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:49:50 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:49:50 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:49:50 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:49:50 user devstack@n-api.service[61852]: X-Project-Id: 32235c67d269474b879a58269c1bfb28 Apr 12 10:49:50 user devstack@n-api.service[61852]: X-Project-Name: tempest-ServerActionsTestJSON-2042231427 Apr 12 10:49:50 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:49:50 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:49:50 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/32235c67d269474b879a58269c1bfb28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32235c67d269474b879a58269c1bfb28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32235c67d269474b879a58269c1bfb28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:49:50 user devstack@n-api.service[61852]: X-Tenant: tempest-ServerActionsTestJSON-2042231427 Apr 12 10:49:50 user devstack@n-api.service[61852]: X-Tenant-Id: 32235c67d269474b879a58269c1bfb28 Apr 12 10:49:50 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-ServerActionsTestJSON-2042231427 Apr 12 10:49:50 user devstack@n-api.service[61852]: X-User: tempest-ServerActionsTestJSON-2042231427-project-member Apr 12 10:49:50 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:49:50 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:49:50 user devstack@n-api.service[61852]: X-User-Id: 0059d31539304ffcb5214b408751cd4f Apr 12 10:49:50 user devstack@n-api.service[61852]: X-User-Name: tempest-ServerActionsTestJSON-2042231427-project-member Apr 12 10:49:50 user devstack@n-api.service[61852]: method: > Apr 12 10:49:50 user devstack@n-api.service[61852]: exception: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 10:49:50 user devstack@n-api.service[61852]: action_args: {'id': 'bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b'} Apr 12 10:49:50 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 10:49:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:49:50 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-bc1ec04d-1751-4af0-b914-f2784f21b0e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Returning 404 to user: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:49:50 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-bc1ec04d-1751-4af0-b914-f2784f21b0e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 404 len: 111 microversion: 2.1 time: 0.027669 Apr 12 10:49:50 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 233/699] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:49:50 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:49:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-39c104d0-cfc0-4e63-8693-39e877dafda9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:49:50 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-39c104d0-cfc0-4e63-8693-39e877dafda9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-39c104d0-cfc0-4e63-8693-39e877dafda9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-39c104d0-cfc0-4e63-8693-39e877dafda9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-39c104d0-cfc0-4e63-8693-39e877dafda9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-39c104d0-cfc0-4e63-8693-39e877dafda9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-39c104d0-cfc0-4e63-8693-39e877dafda9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-39c104d0-cfc0-4e63-8693-39e877dafda9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-39c104d0-cfc0-4e63-8693-39e877dafda9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] HTTP exception thrown: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 10:49:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-39c104d0-cfc0-4e63-8693-39e877dafda9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Request method failure captured: Apr 12 10:49:50 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/os-volume_attachments HTTP/1.1 Apr 12 10:49:50 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:49:50 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:49:50 user devstack@n-api.service[61854]: Connection: close Apr 12 10:49:50 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:49:50 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:49:50 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:49:50 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:49:50 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:49:50 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNolnZNzT2ThxhSuriBvxuvzWZTym4AlaZYFeuKEGLDsI4JQU5J5EPdqePhYq7aD0VLU4aPMYtUubtPCx4cTyFqrT8VJO6mTH-GETo4CcBCG0ZBRUEmmG4Xqag9VuceySJFT8Zl4MMu3msZfldyluyIaplQmRePuPI9QT24i1FtyI7ZE Apr 12 10:49:50 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:49:50 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:49:50 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:49:50 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:49:50 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:49:50 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:49:50 user devstack@n-api.service[61854]: X-Project-Id: 32235c67d269474b879a58269c1bfb28 Apr 12 10:49:50 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServerActionsTestJSON-2042231427 Apr 12 10:49:50 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:49:50 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:49:50 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/32235c67d269474b879a58269c1bfb28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32235c67d269474b879a58269c1bfb28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32235c67d269474b879a58269c1bfb28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:49:50 user devstack@n-api.service[61854]: X-Tenant: tempest-ServerActionsTestJSON-2042231427 Apr 12 10:49:50 user devstack@n-api.service[61854]: X-Tenant-Id: 32235c67d269474b879a58269c1bfb28 Apr 12 10:49:50 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServerActionsTestJSON-2042231427 Apr 12 10:49:50 user devstack@n-api.service[61854]: X-User: tempest-ServerActionsTestJSON-2042231427-project-member Apr 12 10:49:50 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:49:50 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:49:50 user devstack@n-api.service[61854]: X-User-Id: 0059d31539304ffcb5214b408751cd4f Apr 12 10:49:50 user devstack@n-api.service[61854]: X-User-Name: tempest-ServerActionsTestJSON-2042231427-project-member Apr 12 10:49:50 user devstack@n-api.service[61854]: method: > Apr 12 10:49:50 user devstack@n-api.service[61854]: exception: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 10:49:50 user devstack@n-api.service[61854]: action_args: {'server_id': 'bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b'} Apr 12 10:49:50 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 10:49:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:49:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-39c104d0-cfc0-4e63-8693-39e877dafda9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Returning 404 to user: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:49:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-39c104d0-cfc0-4e63-8693-39e877dafda9 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039378 Apr 12 10:49:50 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 239/700] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:49:50 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:49:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d66c5f94-efca-47ed-aa94-1c5e323cc066 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:49:50 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d66c5f94-efca-47ed-aa94-1c5e323cc066 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d66c5f94-efca-47ed-aa94-1c5e323cc066 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d66c5f94-efca-47ed-aa94-1c5e323cc066 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d66c5f94-efca-47ed-aa94-1c5e323cc066 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d66c5f94-efca-47ed-aa94-1c5e323cc066 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d66c5f94-efca-47ed-aa94-1c5e323cc066 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d66c5f94-efca-47ed-aa94-1c5e323cc066 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-d66c5f94-efca-47ed-aa94-1c5e323cc066 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] HTTP exception thrown: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 10:49:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d66c5f94-efca-47ed-aa94-1c5e323cc066 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Request method failure captured: Apr 12 10:49:50 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b HTTP/1.1 Apr 12 10:49:50 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:49:50 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:49:50 user devstack@n-api.service[61853]: Connection: close Apr 12 10:49:50 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:49:50 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:49:50 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:49:50 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:49:50 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:49:50 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolnZNzT2ThxhSuriBvxuvzWZTym4AlaZYFeuKEGLDsI4JQU5J5EPdqePhYq7aD0VLU4aPMYtUubtPCx4cTyFqrT8VJO6mTH-GETo4CcBCG0ZBRUEmmG4Xqag9VuceySJFT8Zl4MMu3msZfldyluyIaplQmRePuPI9QT24i1FtyI7ZE Apr 12 10:49:50 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:49:50 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:49:50 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:49:50 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:49:50 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:49:50 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:49:50 user devstack@n-api.service[61853]: X-Project-Id: 32235c67d269474b879a58269c1bfb28 Apr 12 10:49:50 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServerActionsTestJSON-2042231427 Apr 12 10:49:50 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:49:50 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:49:50 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/32235c67d269474b879a58269c1bfb28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32235c67d269474b879a58269c1bfb28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32235c67d269474b879a58269c1bfb28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:49:50 user devstack@n-api.service[61853]: X-Tenant: tempest-ServerActionsTestJSON-2042231427 Apr 12 10:49:50 user devstack@n-api.service[61853]: X-Tenant-Id: 32235c67d269474b879a58269c1bfb28 Apr 12 10:49:50 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServerActionsTestJSON-2042231427 Apr 12 10:49:50 user devstack@n-api.service[61853]: X-User: tempest-ServerActionsTestJSON-2042231427-project-member Apr 12 10:49:50 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:49:50 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:49:50 user devstack@n-api.service[61853]: X-User-Id: 0059d31539304ffcb5214b408751cd4f Apr 12 10:49:50 user devstack@n-api.service[61853]: X-User-Name: tempest-ServerActionsTestJSON-2042231427-project-member Apr 12 10:49:50 user devstack@n-api.service[61853]: method: > Apr 12 10:49:50 user devstack@n-api.service[61853]: exception: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 10:49:50 user devstack@n-api.service[61853]: action_args: {'id': 'bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b'} Apr 12 10:49:50 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 10:49:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:49:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d66c5f94-efca-47ed-aa94-1c5e323cc066 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Returning 404 to user: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:49:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-d66c5f94-efca-47ed-aa94-1c5e323cc066 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 404 len: 111 microversion: 2.1 time: 0.035189 Apr 12 10:49:50 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 229/701] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:49:50 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:49:50 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2106762264", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "networks": [{"uuid": "f246d51a-9d0f-483e-858e-7f71be8b6085"}], "security_groups": [{"name": "tempest-securitygroup--2109462499"}], "key_name": "tempest-keypair-1241183546", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-1ec650a8-5097-44ae-a864-578a4ebffebe req-2ed9792b-420f-479e-b9f3-5a8827ea6730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76758da6-ef8f-433f-b4e8-8d72f01b6b34", "tag": "65d96800-cdfa-49fe-a407-05d5b661f452"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-1ec650a8-5097-44ae-a864-578a4ebffebe req-2ed9792b-420f-479e-b9f3-5a8827ea6730 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-1ec650a8-5097-44ae-a864-578a4ebffebe req-2ed9792b-420f-479e-b9f3-5a8827ea6730 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-1ec650a8-5097-44ae-a864-578a4ebffebe req-2ed9792b-420f-479e-b9f3-5a8827ea6730 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-1ec650a8-5097-44ae-a864-578a4ebffebe req-2ed9792b-420f-479e-b9f3-5a8827ea6730 service nova] Creating event network-changed:65d96800-cdfa-49fe-a407-05d5b661f452 for instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 on user Apr 12 10:49:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-1ec650a8-5097-44ae-a864-578a4ebffebe req-2ed9792b-420f-479e-b9f3-5a8827ea6730 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072751 Apr 12 10:49:50 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 240/702] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:49:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:49:50 user devstack@n-api.service[61852]: DEBUG nova.network.neutron [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] validate_networks() for [('f246d51a-9d0f-483e-858e-7f71be8b6085', None, None, None, None, None)] {{(pid=61852) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:49:51 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:49:51 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:49:51 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:49:51 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:49:51 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:49:51 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:51 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:51 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:51 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:51 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:51 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:51 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting quotas for project 32235c67d269474b879a58269c1bfb28. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:49:51 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting quotas for user 0059d31539304ffcb5214b408751cd4f and project 32235c67d269474b879a58269c1bfb28. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:49:51 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Going to run 1 instances... {{(pid=61852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:49:51 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:49:51 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.659006 Apr 12 10:49:51 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 234/703] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:49:50 2023] POST /compute/v2.1/servers => generated 404 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 12 10:49:51 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-fe1a5afb-5432-43de-96e6-63f7bcf952a1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:49:51 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-fe1a5afb-5432-43de-96e6-63f7bcf952a1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:49:51 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-fe1a5afb-5432-43de-96e6-63f7bcf952a1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:49:51 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-fe1a5afb-5432-43de-96e6-63f7bcf952a1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" status: 200 len: 1233 microversion: 2.1 time: 0.079341 Apr 12 10:49:51 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 230/704] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:49:51 2023] GET /compute/v2.1/servers/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 => generated 1233 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:49:55 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-9edb00ca-20bb-4f63-86e5-e2dffe1f64db req-f0b4e539-808f-4622-a585-18cc5af6d61f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23", "tag": "59e0f8a4-966b-46f3-921d-be0c6f15f281"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9edb00ca-20bb-4f63-86e5-e2dffe1f64db req-f0b4e539-808f-4622-a585-18cc5af6d61f service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9edb00ca-20bb-4f63-86e5-e2dffe1f64db req-f0b4e539-808f-4622-a585-18cc5af6d61f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-9edb00ca-20bb-4f63-86e5-e2dffe1f64db req-f0b4e539-808f-4622-a585-18cc5af6d61f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:55 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-9edb00ca-20bb-4f63-86e5-e2dffe1f64db req-f0b4e539-808f-4622-a585-18cc5af6d61f service nova] Creating event network-changed:59e0f8a4-966b-46f3-921d-be0c6f15f281 for instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 on user Apr 12 10:49:55 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-9edb00ca-20bb-4f63-86e5-e2dffe1f64db req-f0b4e539-808f-4622-a585-18cc5af6d61f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051651 Apr 12 10:49:55 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 241/705] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:49:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:49:58 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-7e829b76-2290-46d4-a58f-14f97a0bb806 req-4fa976cb-b427-4bdb-accd-8b7700f331fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76758da6-ef8f-433f-b4e8-8d72f01b6b34", "name": "network-vif-plugged", "status": "completed", "tag": "65d96800-cdfa-49fe-a407-05d5b661f452"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-7e829b76-2290-46d4-a58f-14f97a0bb806 req-4fa976cb-b427-4bdb-accd-8b7700f331fb service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-7e829b76-2290-46d4-a58f-14f97a0bb806 req-4fa976cb-b427-4bdb-accd-8b7700f331fb service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-7e829b76-2290-46d4-a58f-14f97a0bb806 req-4fa976cb-b427-4bdb-accd-8b7700f331fb service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:58 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-7e829b76-2290-46d4-a58f-14f97a0bb806 req-4fa976cb-b427-4bdb-accd-8b7700f331fb service nova] Creating event network-vif-plugged:65d96800-cdfa-49fe-a407-05d5b661f452 for instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 on user Apr 12 10:49:58 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-7e829b76-2290-46d4-a58f-14f97a0bb806 req-4fa976cb-b427-4bdb-accd-8b7700f331fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028732 Apr 12 10:49:58 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 235/706] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:49:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:49:58 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-50fae7b5-b948-439c-91ef-aa80d81c2a2c req-a1572dd1-951e-4782-8f5b-d1da79cb059f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23", "name": "network-vif-plugged", "status": "completed", "tag": "59e0f8a4-966b-46f3-921d-be0c6f15f281"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:49:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-50fae7b5-b948-439c-91ef-aa80d81c2a2c req-a1572dd1-951e-4782-8f5b-d1da79cb059f service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:49:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-50fae7b5-b948-439c-91ef-aa80d81c2a2c req-a1572dd1-951e-4782-8f5b-d1da79cb059f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:49:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-50fae7b5-b948-439c-91ef-aa80d81c2a2c req-a1572dd1-951e-4782-8f5b-d1da79cb059f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:49:58 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-50fae7b5-b948-439c-91ef-aa80d81c2a2c req-a1572dd1-951e-4782-8f5b-d1da79cb059f service nova] Creating event network-vif-plugged:59e0f8a4-966b-46f3-921d-be0c6f15f281 for instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 on user Apr 12 10:49:58 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-50fae7b5-b948-439c-91ef-aa80d81c2a2c req-a1572dd1-951e-4782-8f5b-d1da79cb059f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039839 Apr 12 10:49:58 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 231/707] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:49:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:50:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-cd017638-accd-486e-a97e-c21b4da49a3f req-d38c08c3-8c2f-434a-8e5a-c39b397c2efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76758da6-ef8f-433f-b4e8-8d72f01b6b34", "name": "network-vif-plugged", "status": "completed", "tag": "65d96800-cdfa-49fe-a407-05d5b661f452"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:50:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cd017638-accd-486e-a97e-c21b4da49a3f req-d38c08c3-8c2f-434a-8e5a-c39b397c2efa service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cd017638-accd-486e-a97e-c21b4da49a3f req-d38c08c3-8c2f-434a-8e5a-c39b397c2efa service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cd017638-accd-486e-a97e-c21b4da49a3f req-d38c08c3-8c2f-434a-8e5a-c39b397c2efa service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-cd017638-accd-486e-a97e-c21b4da49a3f req-d38c08c3-8c2f-434a-8e5a-c39b397c2efa service nova] Creating event network-vif-plugged:65d96800-cdfa-49fe-a407-05d5b661f452 for instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 on user Apr 12 10:50:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-cd017638-accd-486e-a97e-c21b4da49a3f req-d38c08c3-8c2f-434a-8e5a-c39b397c2efa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037633 Apr 12 10:50:00 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 242/708] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:50:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:50:00 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-9f48afed-4966-4f14-8956-63b10750fd3c req-ca2da6df-0dfb-488c-8f27-fcde93ffcd13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23", "name": "network-vif-plugged", "status": "completed", "tag": "59e0f8a4-966b-46f3-921d-be0c6f15f281"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:50:00 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-9f48afed-4966-4f14-8956-63b10750fd3c req-ca2da6df-0dfb-488c-8f27-fcde93ffcd13 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:00 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-9f48afed-4966-4f14-8956-63b10750fd3c req-ca2da6df-0dfb-488c-8f27-fcde93ffcd13 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:00 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-9f48afed-4966-4f14-8956-63b10750fd3c req-ca2da6df-0dfb-488c-8f27-fcde93ffcd13 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:00 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-9f48afed-4966-4f14-8956-63b10750fd3c req-ca2da6df-0dfb-488c-8f27-fcde93ffcd13 service nova] Creating event network-vif-plugged:59e0f8a4-966b-46f3-921d-be0c6f15f281 for instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 on user Apr 12 10:50:00 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-9f48afed-4966-4f14-8956-63b10750fd3c req-ca2da6df-0dfb-488c-8f27-fcde93ffcd13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028676 Apr 12 10:50:00 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 236/709] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:50:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:50:02 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:50:02 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-314bc3c5-6682-42fb-95fb-f0062896a5ee tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:50:02 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-314bc3c5-6682-42fb-95fb-f0062896a5ee tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:50:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-314bc3c5-6682-42fb-95fb-f0062896a5ee tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-314bc3c5-6682-42fb-95fb-f0062896a5ee tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-314bc3c5-6682-42fb-95fb-f0062896a5ee tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-314bc3c5-6682-42fb-95fb-f0062896a5ee tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-314bc3c5-6682-42fb-95fb-f0062896a5ee tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-314bc3c5-6682-42fb-95fb-f0062896a5ee tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:02 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-314bc3c5-6682-42fb-95fb-f0062896a5ee tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:50:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-314bc3c5-6682-42fb-95fb-f0062896a5ee tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd" status: 200 len: 1391 microversion: 2.1 time: 0.156776 Apr 12 10:50:02 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 232/710] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:50:02 2023] GET /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:50:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ecb4a1a0-544f-4b71-afa0-1e911f2faaa6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:50:06 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-ecb4a1a0-544f-4b71-afa0-1e911f2faaa6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:50:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ecb4a1a0-544f-4b71-afa0-1e911f2faaa6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ecb4a1a0-544f-4b71-afa0-1e911f2faaa6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ecb4a1a0-544f-4b71-afa0-1e911f2faaa6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ecb4a1a0-544f-4b71-afa0-1e911f2faaa6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ecb4a1a0-544f-4b71-afa0-1e911f2faaa6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ecb4a1a0-544f-4b71-afa0-1e911f2faaa6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:07 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-ecb4a1a0-544f-4b71-afa0-1e911f2faaa6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec47d3cdacb45e5a39509e76b546e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cecbfbfd5f42dbb663367f6fbdf3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:50:07 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ecb4a1a0-544f-4b71-afa0-1e911f2faaa6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7" status: 200 len: 1545 microversion: 2.1 time: 0.162863 Apr 12 10:50:07 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 243/711] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:50:06 2023] GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7 => generated 1545 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:50:11 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:50:11 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:50:11 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:50:11 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:50:11 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-10d6ac18-4dd8-43ea-b476-0956f98893b0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:50:11 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-10d6ac18-4dd8-43ea-b476-0956f98893b0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:50:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-10d6ac18-4dd8-43ea-b476-0956f98893b0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-10d6ac18-4dd8-43ea-b476-0956f98893b0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-10d6ac18-4dd8-43ea-b476-0956f98893b0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-10d6ac18-4dd8-43ea-b476-0956f98893b0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-10d6ac18-4dd8-43ea-b476-0956f98893b0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-10d6ac18-4dd8-43ea-b476-0956f98893b0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:11 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-10d6ac18-4dd8-43ea-b476-0956f98893b0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053301 Apr 12 10:50:11 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 237/712] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:50:11 2023] GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 10:50:11 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-87deaef6-552d-45de-bed5-77e87b9cd7b4 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:50:11 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-87deaef6-552d-45de-bed5-77e87b9cd7b4 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:50:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-87deaef6-552d-45de-bed5-77e87b9cd7b4 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-87deaef6-552d-45de-bed5-77e87b9cd7b4 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-87deaef6-552d-45de-bed5-77e87b9cd7b4 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-87deaef6-552d-45de-bed5-77e87b9cd7b4 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-87deaef6-552d-45de-bed5-77e87b9cd7b4 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-87deaef6-552d-45de-bed5-77e87b9cd7b4 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:11 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-87deaef6-552d-45de-bed5-77e87b9cd7b4 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] HTTP exception thrown: Instance d687131b-6853-4d65-b8f7-ecef019ae9f3 is not attached to volume 28d188bd-314c-45f4-b762-cb2b3be5b226 Apr 12 10:50:11 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-87deaef6-552d-45de-bed5-77e87b9cd7b4 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Request method failure captured: Apr 12 10:50:11 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3/os-volume_attachments/28d188bd-314c-45f4-b762-cb2b3be5b226 HTTP/1.1 Apr 12 10:50:11 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:50:11 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:50:11 user devstack@n-api.service[61853]: Connection: close Apr 12 10:50:11 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:50:11 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:50:11 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:50:11 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:50:11 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:50:11 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNouwKaXaYhzw16o-0RmcYnB2vWXKp9V3tYvDadrCoi5enSg9cOgAwt8tJqWWBok9dqnjmTB2D-ZxTjJ_y3NnLll64p9kiYAUAwTGwJnB1xEAd70imb5w5FRbC8ttE3EjQl-W7mLs8xTx-jgIkSXAzVX82xeCBk1qBa6oFUWEA4HcNt0 Apr 12 10:50:11 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:50:11 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:50:11 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:50:11 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:50:11 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:50:11 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:50:11 user devstack@n-api.service[61853]: X-Project-Id: b467fac451ee466fb93cec3d3aa3b408 Apr 12 10:50:11 user devstack@n-api.service[61853]: X-Project-Name: tempest-TestMinimumBasicScenario-2095634766 Apr 12 10:50:11 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:50:11 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:50:11 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b467fac451ee466fb93cec3d3aa3b408"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b467fac451ee466fb93cec3d3aa3b408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b467fac451ee466fb93cec3d3aa3b408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:50:11 user devstack@n-api.service[61853]: X-Tenant: tempest-TestMinimumBasicScenario-2095634766 Apr 12 10:50:11 user devstack@n-api.service[61853]: X-Tenant-Id: b467fac451ee466fb93cec3d3aa3b408 Apr 12 10:50:11 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2095634766 Apr 12 10:50:11 user devstack@n-api.service[61853]: X-User: tempest-TestMinimumBasicScenario-2095634766-project-member Apr 12 10:50:11 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:50:11 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:50:11 user devstack@n-api.service[61853]: X-User-Id: a633ec4046a9467683cbfd2ebe59600f Apr 12 10:50:11 user devstack@n-api.service[61853]: X-User-Name: tempest-TestMinimumBasicScenario-2095634766-project-member Apr 12 10:50:11 user devstack@n-api.service[61853]: method: > Apr 12 10:50:11 user devstack@n-api.service[61853]: exception: Instance d687131b-6853-4d65-b8f7-ecef019ae9f3 is not attached to volume 28d188bd-314c-45f4-b762-cb2b3be5b226 Apr 12 10:50:11 user devstack@n-api.service[61853]: action_args: {'server_id': 'd687131b-6853-4d65-b8f7-ecef019ae9f3', 'id': '28d188bd-314c-45f4-b762-cb2b3be5b226'} Apr 12 10:50:11 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 28d188bd-314c-45f4-b762-cb2b3be5b226. Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d687131b-6853-4d65-b8f7-ecef019ae9f3 is not attached to volume 28d188bd-314c-45f4-b762-cb2b3be5b226 Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d687131b-6853-4d65-b8f7-ecef019ae9f3 is not attached to volume 28d188bd-314c-45f4-b762-cb2b3be5b226 Apr 12 10:50:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:50:11 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-87deaef6-552d-45de-bed5-77e87b9cd7b4 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Returning 404 to user: Instance d687131b-6853-4d65-b8f7-ecef019ae9f3 is not attached to volume 28d188bd-314c-45f4-b762-cb2b3be5b226 {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:50:11 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-87deaef6-552d-45de-bed5-77e87b9cd7b4 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3/os-volume_attachments/28d188bd-314c-45f4-b762-cb2b3be5b226" status: 404 len: 154 microversion: 2.1 time: 0.090682 Apr 12 10:50:11 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 233/713] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 10:50:11 2023] DELETE /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3/os-volume_attachments/28d188bd-314c-45f4-b762-cb2b3be5b226 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:50:14 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:50:14 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:50:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:15 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:50:15 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3" status: 204 len: 0 microversion: 2.1 time: 0.126409 Apr 12 10:50:15 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 244/714] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:50:14 2023] DELETE /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:50:15 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-1b83f4aa-ae6d-49da-aace-c24116c7c0d5 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:50:15 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-1b83f4aa-ae6d-49da-aace-c24116c7c0d5 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:50:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-1b83f4aa-ae6d-49da-aace-c24116c7c0d5 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-1b83f4aa-ae6d-49da-aace-c24116c7c0d5 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-1b83f4aa-ae6d-49da-aace-c24116c7c0d5 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-1b83f4aa-ae6d-49da-aace-c24116c7c0d5 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-1b83f4aa-ae6d-49da-aace-c24116c7c0d5 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-1b83f4aa-ae6d-49da-aace-c24116c7c0d5 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:15 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-1b83f4aa-ae6d-49da-aace-c24116c7c0d5 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:50:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-1b83f4aa-ae6d-49da-aace-c24116c7c0d5 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3" status: 200 len: 1541 microversion: 2.1 time: 0.236270 Apr 12 10:50:15 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 238/715] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:50:15 2023] GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3 => generated 1541 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:50:15 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-865c6b25-b216-479d-a354-671bbc8c1bab req-1ec79450-cff3-4e70-9b99-2befa0ed94ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d687131b-6853-4d65-b8f7-ecef019ae9f3", "name": "network-vif-unplugged", "status": "completed", "tag": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:50:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-865c6b25-b216-479d-a354-671bbc8c1bab req-1ec79450-cff3-4e70-9b99-2befa0ed94ff service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-865c6b25-b216-479d-a354-671bbc8c1bab req-1ec79450-cff3-4e70-9b99-2befa0ed94ff service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-865c6b25-b216-479d-a354-671bbc8c1bab req-1ec79450-cff3-4e70-9b99-2befa0ed94ff service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-865c6b25-b216-479d-a354-671bbc8c1bab req-1ec79450-cff3-4e70-9b99-2befa0ed94ff service nova] Creating event network-vif-unplugged:04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance d687131b-6853-4d65-b8f7-ecef019ae9f3 on user Apr 12 10:50:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-865c6b25-b216-479d-a354-671bbc8c1bab req-1ec79450-cff3-4e70-9b99-2befa0ed94ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027829 Apr 12 10:50:15 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 234/716] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:50:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:50:16 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-ad45c2e9-2cb5-464c-b6cb-7ba9e495ad99 req-32a267bc-7a61-4623-a383-f3a273483436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d687131b-6853-4d65-b8f7-ecef019ae9f3", "name": "network-vif-deleted", "tag": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:50:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ad45c2e9-2cb5-464c-b6cb-7ba9e495ad99 req-32a267bc-7a61-4623-a383-f3a273483436 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ad45c2e9-2cb5-464c-b6cb-7ba9e495ad99 req-32a267bc-7a61-4623-a383-f3a273483436 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ad45c2e9-2cb5-464c-b6cb-7ba9e495ad99 req-32a267bc-7a61-4623-a383-f3a273483436 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-ad45c2e9-2cb5-464c-b6cb-7ba9e495ad99 req-32a267bc-7a61-4623-a383-f3a273483436 service nova] Creating event network-vif-deleted:04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance d687131b-6853-4d65-b8f7-ecef019ae9f3 on user Apr 12 10:50:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-ad45c2e9-2cb5-464c-b6cb-7ba9e495ad99 req-32a267bc-7a61-4623-a383-f3a273483436 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033453 Apr 12 10:50:16 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 245/717] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:50:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:50:16 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-4f1f352d-6047-4fa0-aea0-bb854c608d62 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:50:16 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-4f1f352d-6047-4fa0-aea0-bb854c608d62 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:50:16 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4f1f352d-6047-4fa0-aea0-bb854c608d62 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:16 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4f1f352d-6047-4fa0-aea0-bb854c608d62 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:16 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4f1f352d-6047-4fa0-aea0-bb854c608d62 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:16 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4f1f352d-6047-4fa0-aea0-bb854c608d62 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:16 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4f1f352d-6047-4fa0-aea0-bb854c608d62 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:16 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4f1f352d-6047-4fa0-aea0-bb854c608d62 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:16 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-4f1f352d-6047-4fa0-aea0-bb854c608d62 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:50:16 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-4f1f352d-6047-4fa0-aea0-bb854c608d62 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48" status: 200 len: 1504 microversion: 2.1 time: 0.325232 Apr 12 10:50:16 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 239/718] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:50:16 2023] GET /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48 => generated 1504 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:50:17 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-17245c46-2b49-424e-b3ea-a7b5c0c89206 req-d568adaa-15b3-4c72-9d09-98dab3f9700b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d687131b-6853-4d65-b8f7-ecef019ae9f3", "name": "network-vif-plugged", "status": "completed", "tag": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:50:17 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=19 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:50:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-17245c46-2b49-424e-b3ea-a7b5c0c89206 req-d568adaa-15b3-4c72-9d09-98dab3f9700b service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-17245c46-2b49-424e-b3ea-a7b5c0c89206 req-d568adaa-15b3-4c72-9d09-98dab3f9700b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-17245c46-2b49-424e-b3ea-a7b5c0c89206 req-d568adaa-15b3-4c72-9d09-98dab3f9700b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:17 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:50:17 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-17245c46-2b49-424e-b3ea-a7b5c0c89206 req-d568adaa-15b3-4c72-9d09-98dab3f9700b service nova] Creating event network-vif-plugged:04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance d687131b-6853-4d65-b8f7-ecef019ae9f3 on user Apr 12 10:50:17 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-17245c46-2b49-424e-b3ea-a7b5c0c89206 req-d568adaa-15b3-4c72-9d09-98dab3f9700b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035107 Apr 12 10:50:17 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 235/719] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:50:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:50:36 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:50:36 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:50:36 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-1786357b-cb4f-4314-b206-d21377cd3fdd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:50:36 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-1786357b-cb4f-4314-b206-d21377cd3fdd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:50:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1786357b-cb4f-4314-b206-d21377cd3fdd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1786357b-cb4f-4314-b206-d21377cd3fdd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1786357b-cb4f-4314-b206-d21377cd3fdd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1786357b-cb4f-4314-b206-d21377cd3fdd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1786357b-cb4f-4314-b206-d21377cd3fdd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1786357b-cb4f-4314-b206-d21377cd3fdd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-1786357b-cb4f-4314-b206-d21377cd3fdd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/action" status: 202 len: 0 microversion: 2.87 time: 0.096123 Apr 12 10:50:36 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 246/720] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 10:50:36 2023] POST /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:50:36 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-f1ac853e-329b-487c-812f-a233fe063579 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:50:36 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-f1ac853e-329b-487c-812f-a233fe063579 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:50:36 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:50:36 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=18 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:50:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f1ac853e-329b-487c-812f-a233fe063579 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f1ac853e-329b-487c-812f-a233fe063579 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f1ac853e-329b-487c-812f-a233fe063579 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f1ac853e-329b-487c-812f-a233fe063579 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f1ac853e-329b-487c-812f-a233fe063579 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f1ac853e-329b-487c-812f-a233fe063579 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:36 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-f1ac853e-329b-487c-812f-a233fe063579 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:50:36 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-f1ac853e-329b-487c-812f-a233fe063579 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:50:36 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-f1ac853e-329b-487c-812f-a233fe063579 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:50:36 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-f1ac853e-329b-487c-812f-a233fe063579 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" status: 200 len: 1761 microversion: 2.87 time: 0.239919 Apr 12 10:50:36 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 240/721] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:50:36 2023] GET /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa => generated 1761 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:50:36 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-01e42d6c-29ea-4b43-a042-99d383b20b5e req-f8016e9a-d22f-4146-8679-b701e371e8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa", "name": "network-vif-unplugged", "status": "completed", "tag": "48ecbe51-c168-45fd-9029-d5cfa270e5c5"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:50:36 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:50:36 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:50:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-01e42d6c-29ea-4b43-a042-99d383b20b5e req-f8016e9a-d22f-4146-8679-b701e371e8aa service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-01e42d6c-29ea-4b43-a042-99d383b20b5e req-f8016e9a-d22f-4146-8679-b701e371e8aa service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-01e42d6c-29ea-4b43-a042-99d383b20b5e req-f8016e9a-d22f-4146-8679-b701e371e8aa service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-01e42d6c-29ea-4b43-a042-99d383b20b5e req-f8016e9a-d22f-4146-8679-b701e371e8aa service nova] Creating event network-vif-unplugged:48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa on user Apr 12 10:50:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-01e42d6c-29ea-4b43-a042-99d383b20b5e req-f8016e9a-d22f-4146-8679-b701e371e8aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035280 Apr 12 10:50:36 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 236/722] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:50:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:50:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-c936f72a-b040-459b-8bf3-6bae10107221 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:50:38 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-c936f72a-b040-459b-8bf3-6bae10107221 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:50:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c936f72a-b040-459b-8bf3-6bae10107221 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c936f72a-b040-459b-8bf3-6bae10107221 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c936f72a-b040-459b-8bf3-6bae10107221 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c936f72a-b040-459b-8bf3-6bae10107221 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c936f72a-b040-459b-8bf3-6bae10107221 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c936f72a-b040-459b-8bf3-6bae10107221 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:38 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa", "name": "network-vif-plugged", "status": "completed", "tag": "48ecbe51-c168-45fd-9029-d5cfa270e5c5"}, {"server_uuid": "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa", "name": "network-vif-plugged", "status": "completed", "tag": "48ecbe51-c168-45fd-9029-d5cfa270e5c5"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:50:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:38 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] Creating event network-vif-plugged:48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa on user Apr 12 10:50:38 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] Creating event network-vif-plugged:48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa on user Apr 12 10:50:38 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030468 Apr 12 10:50:38 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 241/723] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:50:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:50:39 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-c936f72a-b040-459b-8bf3-6bae10107221 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:50:39 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-c936f72a-b040-459b-8bf3-6bae10107221 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:50:39 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-c936f72a-b040-459b-8bf3-6bae10107221 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:50:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-c936f72a-b040-459b-8bf3-6bae10107221 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34" status: 200 len: 1704 microversion: 2.20 time: 0.234918 Apr 12 10:50:39 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 247/724] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:50:38 2023] GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34 => generated 1704 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:50:41 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-fb237e29-3d1f-49c9-bdf0-b62fbca5e1c5 req-99d85af1-0d38-4b1b-b3fc-95d1c8020e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa", "name": "network-vif-plugged", "status": "completed", "tag": "48ecbe51-c168-45fd-9029-d5cfa270e5c5"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:50:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-fb237e29-3d1f-49c9-bdf0-b62fbca5e1c5 req-99d85af1-0d38-4b1b-b3fc-95d1c8020e22 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-fb237e29-3d1f-49c9-bdf0-b62fbca5e1c5 req-99d85af1-0d38-4b1b-b3fc-95d1c8020e22 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-fb237e29-3d1f-49c9-bdf0-b62fbca5e1c5 req-99d85af1-0d38-4b1b-b3fc-95d1c8020e22 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-fb237e29-3d1f-49c9-bdf0-b62fbca5e1c5 req-99d85af1-0d38-4b1b-b3fc-95d1c8020e22 service nova] Creating event network-vif-plugged:48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa on user Apr 12 10:50:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-fb237e29-3d1f-49c9-bdf0-b62fbca5e1c5 req-99d85af1-0d38-4b1b-b3fc-95d1c8020e22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030002 Apr 12 10:50:41 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 237/725] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:50:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:50:41 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-e8a0c2fa-dbcd-48ec-94b5-8e94d2108ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:50:41 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-e8a0c2fa-dbcd-48ec-94b5-8e94d2108ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:50:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e8a0c2fa-dbcd-48ec-94b5-8e94d2108ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e8a0c2fa-dbcd-48ec-94b5-8e94d2108ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e8a0c2fa-dbcd-48ec-94b5-8e94d2108ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e8a0c2fa-dbcd-48ec-94b5-8e94d2108ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:50:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e8a0c2fa-dbcd-48ec-94b5-8e94d2108ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:50:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e8a0c2fa-dbcd-48ec-94b5-8e94d2108ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:50:41 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-e8a0c2fa-dbcd-48ec-94b5-8e94d2108ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:50:41 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-e8a0c2fa-dbcd-48ec-94b5-8e94d2108ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" status: 200 len: 1539 microversion: 2.1 time: 0.145952 Apr 12 10:50:41 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 242/726] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:50:41 2023] GET /compute/v2.1/servers/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 => generated 1539 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:51:02 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8e42c39f-00a2-463e-bda3-5a6d85004ef4 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:51:02 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-8e42c39f-00a2-463e-bda3-5a6d85004ef4 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:02 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:02 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8e42c39f-00a2-463e-bda3-5a6d85004ef4 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8e42c39f-00a2-463e-bda3-5a6d85004ef4 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8e42c39f-00a2-463e-bda3-5a6d85004ef4 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8e42c39f-00a2-463e-bda3-5a6d85004ef4 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8e42c39f-00a2-463e-bda3-5a6d85004ef4 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8e42c39f-00a2-463e-bda3-5a6d85004ef4 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:02 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-8e42c39f-00a2-463e-bda3-5a6d85004ef4 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:51:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8e42c39f-00a2-463e-bda3-5a6d85004ef4 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd" status: 200 len: 1391 microversion: 2.1 time: 0.176252 Apr 12 10:51:02 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 248/727] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:51:02 2023] GET /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:51:02 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:02 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:02 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5908cd99-56b8-4602-9a49-289505536b28 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-2071342215"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:02 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5908cd99-56b8-4602-9a49-289505536b28 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5908cd99-56b8-4602-9a49-289505536b28 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5908cd99-56b8-4602-9a49-289505536b28 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5908cd99-56b8-4602-9a49-289505536b28 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5908cd99-56b8-4602-9a49-289505536b28 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5908cd99-56b8-4602-9a49-289505536b28 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:02 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5908cd99-56b8-4602-9a49-289505536b28 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:02 user devstack@n-api.service[61853]: INFO nova.compute.api [None req-5908cd99-56b8-4602-9a49-289505536b28 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Attempting to quiesce instance before volume snapshot. Apr 12 10:51:03 user devstack@n-api.service[61853]: INFO nova.compute.api [None req-5908cd99-56b8-4602-9a49-289505536b28 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 12 10:51:03 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5908cd99-56b8-4602-9a49-289505536b28 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Creating snapshot from volume 87ef4ba7-ac18-4477-a31f-f433c041fda8. {{(pid=61853) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 12 10:51:05 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-77a4150b-d23e-4145-bc5a-c344db411be9 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:51:05 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-77a4150b-d23e-4145-bc5a-c344db411be9 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:05 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=8 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:05 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=14 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-77a4150b-d23e-4145-bc5a-c344db411be9 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-77a4150b-d23e-4145-bc5a-c344db411be9 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-77a4150b-d23e-4145-bc5a-c344db411be9 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-77a4150b-d23e-4145-bc5a-c344db411be9 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-77a4150b-d23e-4145-bc5a-c344db411be9 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-77a4150b-d23e-4145-bc5a-c344db411be9 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:05 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-77a4150b-d23e-4145-bc5a-c344db411be9 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] HTTP exception thrown: Instance d687131b-6853-4d65-b8f7-ecef019ae9f3 could not be found. Apr 12 10:51:05 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-77a4150b-d23e-4145-bc5a-c344db411be9 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Request method failure captured: Apr 12 10:51:05 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3 HTTP/1.1 Apr 12 10:51:05 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:51:05 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:51:05 user devstack@n-api.service[61852]: Connection: close Apr 12 10:51:05 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:51:05 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:51:05 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:51:05 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:51:05 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:51:05 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNouwKaXaYhzw16o-0RmcYnB2vWXKp9V3tYvDadrCoi5enSg9cOgAwt8tJqWWBok9dqnjmTB2D-ZxTjJ_y3NnLll64p9kiYAUAwTGwJnB1xEAd70imb5w5FRbC8ttE3EjQl-W7mLs8xTx-jgIkSXAzVX82xeCBk1qBa6oFUWEA4HcNt0 Apr 12 10:51:05 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:51:05 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:51:05 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:51:05 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:51:05 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:51:05 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:51:05 user devstack@n-api.service[61852]: X-Project-Id: b467fac451ee466fb93cec3d3aa3b408 Apr 12 10:51:05 user devstack@n-api.service[61852]: X-Project-Name: tempest-TestMinimumBasicScenario-2095634766 Apr 12 10:51:05 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:51:05 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:51:05 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b467fac451ee466fb93cec3d3aa3b408"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b467fac451ee466fb93cec3d3aa3b408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b467fac451ee466fb93cec3d3aa3b408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:51:05 user devstack@n-api.service[61852]: X-Tenant: tempest-TestMinimumBasicScenario-2095634766 Apr 12 10:51:05 user devstack@n-api.service[61852]: X-Tenant-Id: b467fac451ee466fb93cec3d3aa3b408 Apr 12 10:51:05 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2095634766 Apr 12 10:51:05 user devstack@n-api.service[61852]: X-User: tempest-TestMinimumBasicScenario-2095634766-project-member Apr 12 10:51:05 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:51:05 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:51:05 user devstack@n-api.service[61852]: X-User-Id: a633ec4046a9467683cbfd2ebe59600f Apr 12 10:51:05 user devstack@n-api.service[61852]: X-User-Name: tempest-TestMinimumBasicScenario-2095634766-project-member Apr 12 10:51:05 user devstack@n-api.service[61852]: method: > Apr 12 10:51:05 user devstack@n-api.service[61852]: exception: Instance d687131b-6853-4d65-b8f7-ecef019ae9f3 could not be found. Apr 12 10:51:05 user devstack@n-api.service[61852]: action_args: {'id': 'd687131b-6853-4d65-b8f7-ecef019ae9f3'} Apr 12 10:51:05 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d687131b-6853-4d65-b8f7-ecef019ae9f3 could not be found. Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d687131b-6853-4d65-b8f7-ecef019ae9f3 could not be found. Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d687131b-6853-4d65-b8f7-ecef019ae9f3 could not be found. Apr 12 10:51:05 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:51:05 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-77a4150b-d23e-4145-bc5a-c344db411be9 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Returning 404 to user: Instance d687131b-6853-4d65-b8f7-ecef019ae9f3 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:51:05 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-77a4150b-d23e-4145-bc5a-c344db411be9 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3" status: 404 len: 111 microversion: 2.1 time: 0.035945 Apr 12 10:51:05 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 243/728] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:51:05 2023] GET /compute/v2.1/servers/d687131b-6853-4d65-b8f7-ecef019ae9f3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:51:05 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-717f8220-07df-4b03-a4bc-db005e31ad40 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '.version_select at 0x7fabbf78b5b0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:51:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-717f8220-07df-4b03-a4bc-db005e31ad40 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2015119923" status: 202 len: 0 microversion: 2.1 time: 0.024023 Apr 12 10:51:05 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 249/729] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 12 10:51:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2015119923 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:51:05 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5908cd99-56b8-4602-9a49-289505536b28 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd/action" status: 202 len: 0 microversion: 2.1 time: 2.666638 Apr 12 10:51:05 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 238/730] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:51:02 2023] POST /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd/action => generated 0 bytes in 2668 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 10:51:05 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1490063816", "imageRef": "877d5436-0b95-4a8d-a3b4-2f4d4699201a", "flavorRef": "42", "networks": [{"uuid": "3ecf6069-4851-431c-a1c3-13e94566fa0b"}]}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:05 user devstack@n-api.service[61852]: DEBUG nova.network.neutron [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] validate_networks() for [('3ecf6069-4851-431c-a1c3-13e94566fa0b', None, None, None, None, None)] {{(pid=61852) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:51:06 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:51:06 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:51:06 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:51:06 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:51:06 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:51:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:06 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting quotas for project a67f3d23b8f74a9496d445c7fc75717e. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:51:06 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting quotas for user b914d7ca786f455baf120f98816abffd and project a67f3d23b8f74a9496d445c7fc75717e. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:51:06 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Going to run 1 instances... {{(pid=61852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:51:06 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='35b42ae4-aa5d-430f-9501-d3d0ce6c5196',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:51:06 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.604885 Apr 12 10:51:06 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 244/731] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:51:05 2023] POST /compute/v2.1/servers => generated 378 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:51:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-04ae86f5-be9b-446f-9fff-d23f430e9963 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:51:06 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-04ae86f5-be9b-446f-9fff-d23f430e9963 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:06 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-04ae86f5-be9b-446f-9fff-d23f430e9963 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:51:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-04ae86f5-be9b-446f-9fff-d23f430e9963 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" status: 200 len: 1224 microversion: 2.1 time: 0.074686 Apr 12 10:51:06 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 250/732] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:51:06 2023] GET /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 => generated 1224 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:51:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-55fa7e85-8f80-405e-a3c3-0b6106f5d407 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:51:07 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-55fa7e85-8f80-405e-a3c3-0b6106f5d407 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-55fa7e85-8f80-405e-a3c3-0b6106f5d407 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-55fa7e85-8f80-405e-a3c3-0b6106f5d407 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-55fa7e85-8f80-405e-a3c3-0b6106f5d407 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-55fa7e85-8f80-405e-a3c3-0b6106f5d407 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-55fa7e85-8f80-405e-a3c3-0b6106f5d407 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-55fa7e85-8f80-405e-a3c3-0b6106f5d407 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-55fa7e85-8f80-405e-a3c3-0b6106f5d407 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.098485 Apr 12 10:51:07 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 239/733] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 10:51:07 2023] GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/os-interface => generated 282 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-19965436-6e7a-454f-9382-fe064f783603 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Action: 'create', calling method: .version_select at 0x7fabbf55e950>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2078556363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0xYo/U9olcXUxWVNjyonA9aJ0xsZ/BfTVAGlL1ocRIDzPvg0PLVDDRxGGzI3LZdJJOo5Z6xxzKLkV/HZdcy8X23bxA81QZoa7yGQZyd2sGv0R6G4fpT0+Ec3zh6AfZuQ=="}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:07 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-19965436-6e7a-454f-9382-fe064f783603 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Getting quotas for project b467fac451ee466fb93cec3d3aa3b408. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:51:07 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-19965436-6e7a-454f-9382-fe064f783603 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Getting quotas for user a633ec4046a9467683cbfd2ebe59600f and project b467fac451ee466fb93cec3d3aa3b408. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:51:07 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-19965436-6e7a-454f-9382-fe064f783603 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.046928 Apr 12 10:51:07 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 245/734] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 10:51:07 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:07 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1484132394", "imageRef": "92fcccc4-57d4-4cb0-872e-507fce12c392", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-2078556363", "networks": [{"uuid": "d284a588-7406-446d-af3c-874a119b7536"}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:07 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] validate_networks() for [('d284a588-7406-446d-af3c-874a119b7536', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:51:08 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-c3cce680-33cf-42bc-9105-2d461a99118f req-aa9faa23-affb-4b37-a171-f229590ba985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82ea43d4-f2b9-4665-b1c9-412367e2b4d7", "tag": "a41db5a9-2805-455d-b27e-72e11d4f1012"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-c3cce680-33cf-42bc-9105-2d461a99118f req-aa9faa23-affb-4b37-a171-f229590ba985 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-c3cce680-33cf-42bc-9105-2d461a99118f req-aa9faa23-affb-4b37-a171-f229590ba985 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-c3cce680-33cf-42bc-9105-2d461a99118f req-aa9faa23-affb-4b37-a171-f229590ba985 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:08 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-c3cce680-33cf-42bc-9105-2d461a99118f req-aa9faa23-affb-4b37-a171-f229590ba985 service nova] Creating event network-changed:a41db5a9-2805-455d-b27e-72e11d4f1012 for instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 on user Apr 12 10:51:08 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-c3cce680-33cf-42bc-9105-2d461a99118f req-aa9faa23-affb-4b37-a171-f229590ba985 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031417 Apr 12 10:51:08 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 240/735] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:51:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:08 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:51:08 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:51:08 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:51:08 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:51:08 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:51:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:08 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Getting quotas for project b467fac451ee466fb93cec3d3aa3b408. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:51:08 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Getting quotas for user a633ec4046a9467683cbfd2ebe59600f and project b467fac451ee466fb93cec3d3aa3b408. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:51:08 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:51:08 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92fcccc4-57d4-4cb0-872e-507fce12c392',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:51:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.695403 Apr 12 10:51:08 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 251/736] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:51:07 2023] POST /compute/v2.1/servers => generated 378 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:51:08 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-8da73fa9-4677-4af8-81cd-8f1530ef803f tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:51:08 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-8da73fa9-4677-4af8-81cd-8f1530ef803f tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:08 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-8da73fa9-4677-4af8-81cd-8f1530ef803f tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:51:08 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-8da73fa9-4677-4af8-81cd-8f1530ef803f tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc" status: 200 len: 1253 microversion: 2.1 time: 0.086504 Apr 12 10:51:08 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 246/737] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:51:08 2023] GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc => generated 1253 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:51:09 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c6e58325-53bd-4d56-9d8c-174210b8744a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:51:09 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c6e58325-53bd-4d56-9d8c-174210b8744a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c6e58325-53bd-4d56-9d8c-174210b8744a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c6e58325-53bd-4d56-9d8c-174210b8744a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c6e58325-53bd-4d56-9d8c-174210b8744a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c6e58325-53bd-4d56-9d8c-174210b8744a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c6e58325-53bd-4d56-9d8c-174210b8744a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c6e58325-53bd-4d56-9d8c-174210b8744a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c6e58325-53bd-4d56-9d8c-174210b8744a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/ips" status: 200 len: 146 microversion: 2.1 time: 0.064997 Apr 12 10:51:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 241/738] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 10:51:09 2023] GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/ips => generated 146 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:09 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-8364c15f-d44e-424d-a79e-d810f8cade0d req-891c1fe3-84de-4eca-9e18-e42e3e1c2633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8", "tag": "2c64da14-81c7-48d5-b272-2e09127f33fd"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8364c15f-d44e-424d-a79e-d810f8cade0d req-891c1fe3-84de-4eca-9e18-e42e3e1c2633 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8364c15f-d44e-424d-a79e-d810f8cade0d req-891c1fe3-84de-4eca-9e18-e42e3e1c2633 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8364c15f-d44e-424d-a79e-d810f8cade0d req-891c1fe3-84de-4eca-9e18-e42e3e1c2633 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:09 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-8364c15f-d44e-424d-a79e-d810f8cade0d req-891c1fe3-84de-4eca-9e18-e42e3e1c2633 service nova] Creating event network-changed:2c64da14-81c7-48d5-b272-2e09127f33fd for instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 on user Apr 12 10:51:09 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-8364c15f-d44e-424d-a79e-d810f8cade0d req-891c1fe3-84de-4eca-9e18-e42e3e1c2633 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092283 Apr 12 10:51:09 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 252/739] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:51:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:10 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "054aa7d1-a508-4c31-8332-900e26be41b0"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:10 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:11 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "POST /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352125 Apr 12 10:51:11 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 247/740] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:51:10 2023] POST /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/os-volume_attachments => generated 194 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:11 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-57ac003a-7f42-4594-af05-8c7d435a7573 req-9e394fd6-f035-4324-b3f0-43cd4158130f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc51c71-9d3b-4957-b912-0666c68b46fc", "tag": "66db319f-02d8-4e75-b71a-2b2d136671a9"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-57ac003a-7f42-4594-af05-8c7d435a7573 req-9e394fd6-f035-4324-b3f0-43cd4158130f service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-57ac003a-7f42-4594-af05-8c7d435a7573 req-9e394fd6-f035-4324-b3f0-43cd4158130f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-57ac003a-7f42-4594-af05-8c7d435a7573 req-9e394fd6-f035-4324-b3f0-43cd4158130f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:11 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-57ac003a-7f42-4594-af05-8c7d435a7573 req-9e394fd6-f035-4324-b3f0-43cd4158130f service nova] Creating event network-changed:66db319f-02d8-4e75-b71a-2b2d136671a9 for instance cdc51c71-9d3b-4957-b912-0666c68b46fc on user Apr 12 10:51:11 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-57ac003a-7f42-4594-af05-8c7d435a7573 req-9e394fd6-f035-4324-b3f0-43cd4158130f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079732 Apr 12 10:51:11 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 242/741] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:51:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-f278b282-5aa9-44e8-86ee-2cd5c742ad90 req-23421021-21e4-4551-955b-727f30818c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc51c71-9d3b-4957-b912-0666c68b46fc", "name": "network-vif-plugged", "status": "completed", "tag": "66db319f-02d8-4e75-b71a-2b2d136671a9"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f278b282-5aa9-44e8-86ee-2cd5c742ad90 req-23421021-21e4-4551-955b-727f30818c29 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f278b282-5aa9-44e8-86ee-2cd5c742ad90 req-23421021-21e4-4551-955b-727f30818c29 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f278b282-5aa9-44e8-86ee-2cd5c742ad90 req-23421021-21e4-4551-955b-727f30818c29 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f278b282-5aa9-44e8-86ee-2cd5c742ad90 req-23421021-21e4-4551-955b-727f30818c29 service nova] Creating event network-vif-plugged:66db319f-02d8-4e75-b71a-2b2d136671a9 for instance cdc51c71-9d3b-4957-b912-0666c68b46fc on user Apr 12 10:51:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-f278b282-5aa9-44e8-86ee-2cd5c742ad90 req-23421021-21e4-4551-955b-727f30818c29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037632 Apr 12 10:51:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 253/742] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:51:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:15 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-87d422e7-538d-470a-aa85-15a1ca67a530 req-99fd3e8e-8c7b-4d9c-aab5-9bfc8858aa47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc51c71-9d3b-4957-b912-0666c68b46fc", "name": "network-vif-plugged", "status": "completed", "tag": "66db319f-02d8-4e75-b71a-2b2d136671a9"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-87d422e7-538d-470a-aa85-15a1ca67a530 req-99fd3e8e-8c7b-4d9c-aab5-9bfc8858aa47 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-87d422e7-538d-470a-aa85-15a1ca67a530 req-99fd3e8e-8c7b-4d9c-aab5-9bfc8858aa47 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-87d422e7-538d-470a-aa85-15a1ca67a530 req-99fd3e8e-8c7b-4d9c-aab5-9bfc8858aa47 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-87d422e7-538d-470a-aa85-15a1ca67a530 req-99fd3e8e-8c7b-4d9c-aab5-9bfc8858aa47 service nova] Creating event network-vif-plugged:66db319f-02d8-4e75-b71a-2b2d136671a9 for instance cdc51c71-9d3b-4957-b912-0666c68b46fc on user Apr 12 10:51:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-87d422e7-538d-470a-aa85-15a1ca67a530 req-99fd3e8e-8c7b-4d9c-aab5-9bfc8858aa47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041933 Apr 12 10:51:15 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 248/743] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:51:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:18 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0707650e-6a1d-413a-8127-deb909c6607d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Action: 'create', calling method: .version_select at 0x7fabbf52b2e0>, body: {"keypair": {"name": "tempest-keypair-1748374270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/YpGpY39pjPnnc5Woimceec0NAaa03OrDNhA1pvgsqwdaodbpAhPJh05gGMZMrWZbb/FVge7phkuwRvAKHKPJI+cKczayHgYAnGWdfu4mixptN5qgJSlvLfPCtJ2jZMw=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:18 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-0707650e-6a1d-413a-8127-deb909c6607d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Getting quotas for project 2b39cd8e55b54a86a7784f2934273e20. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:51:18 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-0707650e-6a1d-413a-8127-deb909c6607d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Getting quotas for user abdf772f2c7341c29159b6f1f2ce7ccb and project 2b39cd8e55b54a86a7784f2934273e20. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:51:18 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-0707650e-6a1d-413a-8127-deb909c6607d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059567 Apr 12 10:51:18 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 243/744] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 10:51:18 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:18 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:18 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=8 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:18 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-38473a46-6d3b-4e1a-be97-82264136c32e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "054aa7d1-a508-4c31-8332-900e26be41b0"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:18 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-38473a46-6d3b-4e1a-be97-82264136c32e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-38473a46-6d3b-4e1a-be97-82264136c32e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-38473a46-6d3b-4e1a-be97-82264136c32e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-38473a46-6d3b-4e1a-be97-82264136c32e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-38473a46-6d3b-4e1a-be97-82264136c32e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-38473a46-6d3b-4e1a-be97-82264136c32e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-38473a46-6d3b-4e1a-be97-82264136c32e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:18 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-38473a46-6d3b-4e1a-be97-82264136c32e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] HTTP exception thrown: Invalid volume: volume 054aa7d1-a508-4c31-8332-900e26be41b0 is already attached to instances: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 Apr 12 10:51:18 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-38473a46-6d3b-4e1a-be97-82264136c32e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Request method failure captured: Apr 12 10:51:18 user devstack@n-api.service[61854]: request: POST /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/os-volume_attachments HTTP/1.1 Apr 12 10:51:18 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:51:18 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:51:18 user devstack@n-api.service[61854]: Connection: close Apr 12 10:51:18 user devstack@n-api.service[61854]: Content-Length: 74 Apr 12 10:51:18 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:51:18 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:51:18 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:51:18 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:51:18 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNosjxmxcVjmUpCMLAxdRdLndUlKxh4MkCcirUvRtNoND63IGb1xoGABQC8D9rLRE4dW_L0z2oNcBU8jtABVmL5XlYtTU15Uvd1NUbrH9hi6BA13fINZDRHpVQlP0DCe8J969vT87xyN1x_qfcLnOr5CvtvwcJHsWkRykm4XG-p9tMms Apr 12 10:51:18 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:51:18 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:51:18 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:51:18 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:51:18 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:51:18 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:51:18 user devstack@n-api.service[61854]: X-Project-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:51:18 user devstack@n-api.service[61854]: X-Project-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:51:18 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:51:18 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:51:18 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:51:18 user devstack@n-api.service[61854]: X-Tenant: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:51:18 user devstack@n-api.service[61854]: X-Tenant-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:51:18 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:51:18 user devstack@n-api.service[61854]: X-User: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:51:18 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:51:18 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:51:18 user devstack@n-api.service[61854]: X-User-Id: 7ec47d3cdacb45e5a39509e76b546e34 Apr 12 10:51:18 user devstack@n-api.service[61854]: X-User-Name: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:51:18 user devstack@n-api.service[61854]: Apr 12 10:51:18 user devstack@n-api.service[61854]: {"volumeAttachment": {"volumeId": "054aa7d1-a508-4c31-8332-900e26be41b0"}} Apr 12 10:51:18 user devstack@n-api.service[61854]: method: > Apr 12 10:51:18 user devstack@n-api.service[61854]: exception: Invalid volume: volume 054aa7d1-a508-4c31-8332-900e26be41b0 is already attached to instances: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 Apr 12 10:51:18 user devstack@n-api.service[61854]: action_args: {'server_id': '82ea43d4-f2b9-4665-b1c9-412367e2b4d7', 'body': {'volumeAttachment': {'volumeId': '054aa7d1-a508-4c31-8332-900e26be41b0'}}} Apr 12 10:51:18 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 054aa7d1-a508-4c31-8332-900e26be41b0 is already attached to instances: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 054aa7d1-a508-4c31-8332-900e26be41b0 is already attached to instances: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 054aa7d1-a508-4c31-8332-900e26be41b0 is already attached to instances: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 Apr 12 10:51:18 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:51:18 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-38473a46-6d3b-4e1a-be97-82264136c32e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Returning 400 to user: Invalid volume: volume 054aa7d1-a508-4c31-8332-900e26be41b0 is already attached to instances: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:51:18 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-38473a46-6d3b-4e1a-be97-82264136c32e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "POST /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.178809 Apr 12 10:51:18 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 254/745] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:51:18 2023] POST /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/os-volume_attachments => generated 174 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:51:19 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:19 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=12 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:19 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:51:19 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:19 user devstack@n-api.service[61852]: DEBUG nova.objects.instance [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'services' on Instance uuid 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 {{(pid=61852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:51:19 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/os-volume_attachments/054aa7d1-a508-4c31-8332-900e26be41b0" status: 202 len: 0 microversion: 2.1 time: 0.166351 Apr 12 10:51:19 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 249/746] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 10:51:19 2023] DELETE /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/os-volume_attachments/054aa7d1-a508-4c31-8332-900e26be41b0 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:51:19 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-6bca43eb-b40c-4a70-81ac-6039ac1a6823 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:51:19 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-6bca43eb-b40c-4a70-81ac-6039ac1a6823 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6bca43eb-b40c-4a70-81ac-6039ac1a6823 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6bca43eb-b40c-4a70-81ac-6039ac1a6823 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6bca43eb-b40c-4a70-81ac-6039ac1a6823 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6bca43eb-b40c-4a70-81ac-6039ac1a6823 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6bca43eb-b40c-4a70-81ac-6039ac1a6823 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6bca43eb-b40c-4a70-81ac-6039ac1a6823 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-6bca43eb-b40c-4a70-81ac-6039ac1a6823 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096570 Apr 12 10:51:19 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 244/747] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:51:19 2023] GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:19 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1704970245", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "98c9dc65-829b-425d-8645-c7e8998720cc"}], "security_groups": [{"name": "tempest-securitygroup--1975775400"}], "key_name": "tempest-keypair-1748374270", "user_data": "}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:19 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] validate_networks() for [('98c9dc65-829b-425d-8645-c7e8998720cc', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:51:20 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:51:20 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:51:20 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:51:20 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:51:20 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:51:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:20 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Getting quotas for project 2b39cd8e55b54a86a7784f2934273e20. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:51:20 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Getting quotas for user abdf772f2c7341c29159b6f1f2ce7ccb and project 2b39cd8e55b54a86a7784f2934273e20. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:51:20 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:51:20 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:51:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.660664 Apr 12 10:51:20 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 255/748] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:51:19 2023] POST /compute/v2.1/servers => generated 407 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:51:20 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-65afac7d-b679-473c-9815-1fc3bf336049 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:51:20 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-65afac7d-b679-473c-9815-1fc3bf336049 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:20 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-65afac7d-b679-473c-9815-1fc3bf336049 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:51:20 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-65afac7d-b679-473c-9815-1fc3bf336049 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22" status: 200 len: 1240 microversion: 2.1 time: 0.063573 Apr 12 10:51:20 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 250/749] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:51:20 2023] GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22 => generated 1240 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:51:21 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-3a240ee4-8bda-4d72-9585-43ffa81fc8be req-40d04dde-026e-456a-8ea3-663dd6fcb584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8", "name": "network-vif-plugged", "status": "completed", "tag": "2c64da14-81c7-48d5-b272-2e09127f33fd"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3a240ee4-8bda-4d72-9585-43ffa81fc8be req-40d04dde-026e-456a-8ea3-663dd6fcb584 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3a240ee4-8bda-4d72-9585-43ffa81fc8be req-40d04dde-026e-456a-8ea3-663dd6fcb584 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3a240ee4-8bda-4d72-9585-43ffa81fc8be req-40d04dde-026e-456a-8ea3-663dd6fcb584 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-3a240ee4-8bda-4d72-9585-43ffa81fc8be req-40d04dde-026e-456a-8ea3-663dd6fcb584 service nova] Creating event network-vif-plugged:2c64da14-81c7-48d5-b272-2e09127f33fd for instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 on user Apr 12 10:51:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-3a240ee4-8bda-4d72-9585-43ffa81fc8be req-40d04dde-026e-456a-8ea3-663dd6fcb584 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040116 Apr 12 10:51:21 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 245/750] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:51:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:23 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-32bdab6d-ab23-46f8-95ac-8ce65e7e53d4 req-a7f310c9-cf56-45a1-9cef-5034d905eaa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faa11b52-f2b6-45aa-937f-7468095ddb22", "tag": "46213af2-2a93-4502-9f35-eda3d5b9f7fc"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-32bdab6d-ab23-46f8-95ac-8ce65e7e53d4 req-a7f310c9-cf56-45a1-9cef-5034d905eaa5 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-32bdab6d-ab23-46f8-95ac-8ce65e7e53d4 req-a7f310c9-cf56-45a1-9cef-5034d905eaa5 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-32bdab6d-ab23-46f8-95ac-8ce65e7e53d4 req-a7f310c9-cf56-45a1-9cef-5034d905eaa5 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-32bdab6d-ab23-46f8-95ac-8ce65e7e53d4 req-a7f310c9-cf56-45a1-9cef-5034d905eaa5 service nova] Creating event network-changed:46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance faa11b52-f2b6-45aa-937f-7468095ddb22 on user Apr 12 10:51:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-32bdab6d-ab23-46f8-95ac-8ce65e7e53d4 req-a7f310c9-cf56-45a1-9cef-5034d905eaa5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045571 Apr 12 10:51:23 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 256/751] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:51:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:23 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-d9e22ffe-a220-425c-826e-6887749316dd req-a3e86654-a933-4e0e-97c5-a9ad78fbfc69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8", "name": "network-vif-plugged", "status": "completed", "tag": "2c64da14-81c7-48d5-b272-2e09127f33fd"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d9e22ffe-a220-425c-826e-6887749316dd req-a3e86654-a933-4e0e-97c5-a9ad78fbfc69 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d9e22ffe-a220-425c-826e-6887749316dd req-a3e86654-a933-4e0e-97c5-a9ad78fbfc69 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d9e22ffe-a220-425c-826e-6887749316dd req-a3e86654-a933-4e0e-97c5-a9ad78fbfc69 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:23 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-d9e22ffe-a220-425c-826e-6887749316dd req-a3e86654-a933-4e0e-97c5-a9ad78fbfc69 service nova] Creating event network-vif-plugged:2c64da14-81c7-48d5-b272-2e09127f33fd for instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 on user Apr 12 10:51:23 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-d9e22ffe-a220-425c-826e-6887749316dd req-a3e86654-a933-4e0e-97c5-a9ad78fbfc69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030221 Apr 12 10:51:23 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 251/752] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:51:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:25 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-e3047c53-5cbd-4903-9696-58080875a0ae req-4243a6d1-0ac6-4a60-85b3-65fd879e9695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa11b52-f2b6-45aa-937f-7468095ddb22", "name": "network-vif-plugged", "status": "completed", "tag": "46213af2-2a93-4502-9f35-eda3d5b9f7fc"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e3047c53-5cbd-4903-9696-58080875a0ae req-4243a6d1-0ac6-4a60-85b3-65fd879e9695 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e3047c53-5cbd-4903-9696-58080875a0ae req-4243a6d1-0ac6-4a60-85b3-65fd879e9695 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-e3047c53-5cbd-4903-9696-58080875a0ae req-4243a6d1-0ac6-4a60-85b3-65fd879e9695 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:25 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-e3047c53-5cbd-4903-9696-58080875a0ae req-4243a6d1-0ac6-4a60-85b3-65fd879e9695 service nova] Creating event network-vif-plugged:46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance faa11b52-f2b6-45aa-937f-7468095ddb22 on user Apr 12 10:51:25 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-e3047c53-5cbd-4903-9696-58080875a0ae req-4243a6d1-0ac6-4a60-85b3-65fd879e9695 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058241 Apr 12 10:51:25 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 246/753] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:51:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-03660fa8-d0a1-40df-8e94-acb3acfb69b3 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:51:26 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-03660fa8-d0a1-40df-8e94-acb3acfb69b3 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-03660fa8-d0a1-40df-8e94-acb3acfb69b3 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-03660fa8-d0a1-40df-8e94-acb3acfb69b3 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-03660fa8-d0a1-40df-8e94-acb3acfb69b3 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-03660fa8-d0a1-40df-8e94-acb3acfb69b3 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-03660fa8-d0a1-40df-8e94-acb3acfb69b3 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-03660fa8-d0a1-40df-8e94-acb3acfb69b3 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:26 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-03660fa8-d0a1-40df-8e94-acb3acfb69b3 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:51:26 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-03660fa8-d0a1-40df-8e94-acb3acfb69b3 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:51:26 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-03660fa8-d0a1-40df-8e94-acb3acfb69b3 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:51:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-03660fa8-d0a1-40df-8e94-acb3acfb69b3 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" status: 200 len: 1767 microversion: 2.87 time: 0.237802 Apr 12 10:51:26 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 257/754] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:51:26 2023] GET /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa => generated 1767 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:51:27 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-5334be81-4e05-4b3a-a59a-0d6721e3abd5 req-c4aa39c3-77c1-4f18-bf5f-421adc6ba18f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa11b52-f2b6-45aa-937f-7468095ddb22", "name": "network-vif-plugged", "status": "completed", "tag": "46213af2-2a93-4502-9f35-eda3d5b9f7fc"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-5334be81-4e05-4b3a-a59a-0d6721e3abd5 req-c4aa39c3-77c1-4f18-bf5f-421adc6ba18f service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-5334be81-4e05-4b3a-a59a-0d6721e3abd5 req-c4aa39c3-77c1-4f18-bf5f-421adc6ba18f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-5334be81-4e05-4b3a-a59a-0d6721e3abd5 req-c4aa39c3-77c1-4f18-bf5f-421adc6ba18f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:27 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-5334be81-4e05-4b3a-a59a-0d6721e3abd5 req-c4aa39c3-77c1-4f18-bf5f-421adc6ba18f service nova] Creating event network-vif-plugged:46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance faa11b52-f2b6-45aa-937f-7468095ddb22 on user Apr 12 10:51:27 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-5334be81-4e05-4b3a-a59a-0d6721e3abd5 req-c4aa39c3-77c1-4f18-bf5f-421adc6ba18f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037740 Apr 12 10:51:27 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 252/755] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:51:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:39 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:39 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:39 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d40cacf5-24aa-42bc-a090-05f783f8a05f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:51:39 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d40cacf5-24aa-42bc-a090-05f783f8a05f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d40cacf5-24aa-42bc-a090-05f783f8a05f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d40cacf5-24aa-42bc-a090-05f783f8a05f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d40cacf5-24aa-42bc-a090-05f783f8a05f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d40cacf5-24aa-42bc-a090-05f783f8a05f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d40cacf5-24aa-42bc-a090-05f783f8a05f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d40cacf5-24aa-42bc-a090-05f783f8a05f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-d40cacf5-24aa-42bc-a090-05f783f8a05f tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.074359 Apr 12 10:51:39 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 247/756] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 10:51:39 2023] GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:51:39 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:51:39 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:39 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:39 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:39 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=28 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:39 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:39 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:51:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34" status: 204 len: 0 microversion: 2.20 time: 0.126734 Apr 12 10:51:39 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 258/757] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 10:51:39 2023] DELETE /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 10:51:39 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:39 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:39 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:39 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-39996522-b82e-479e-9ff8-23fca2ecfd0a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:51:39 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-39996522-b82e-479e-9ff8-23fca2ecfd0a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-39996522-b82e-479e-9ff8-23fca2ecfd0a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-39996522-b82e-479e-9ff8-23fca2ecfd0a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-39996522-b82e-479e-9ff8-23fca2ecfd0a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-39996522-b82e-479e-9ff8-23fca2ecfd0a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-39996522-b82e-479e-9ff8-23fca2ecfd0a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-39996522-b82e-479e-9ff8-23fca2ecfd0a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:39 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-39996522-b82e-479e-9ff8-23fca2ecfd0a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:51:39 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-39996522-b82e-479e-9ff8-23fca2ecfd0a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:51:39 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-39996522-b82e-479e-9ff8-23fca2ecfd0a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:51:39 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-39996522-b82e-479e-9ff8-23fca2ecfd0a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34" status: 200 len: 1710 microversion: 2.20 time: 0.326152 Apr 12 10:51:39 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 253/758] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:51:39 2023] GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34 => generated 1710 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:51:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-fffea540-baff-4e2e-b774-52f0e89e164d req-d5bf5037-f01e-45f7-832d-06561959f58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76758da6-ef8f-433f-b4e8-8d72f01b6b34", "name": "network-vif-unplugged", "status": "completed", "tag": "65d96800-cdfa-49fe-a407-05d5b661f452"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-fffea540-baff-4e2e-b774-52f0e89e164d req-d5bf5037-f01e-45f7-832d-06561959f58f service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-fffea540-baff-4e2e-b774-52f0e89e164d req-d5bf5037-f01e-45f7-832d-06561959f58f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-fffea540-baff-4e2e-b774-52f0e89e164d req-d5bf5037-f01e-45f7-832d-06561959f58f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-fffea540-baff-4e2e-b774-52f0e89e164d req-d5bf5037-f01e-45f7-832d-06561959f58f service nova] Creating event network-vif-unplugged:65d96800-cdfa-49fe-a407-05d5b661f452 for instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 on user Apr 12 10:51:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-fffea540-baff-4e2e-b774-52f0e89e164d req-d5bf5037-f01e-45f7-832d-06561959f58f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057326 Apr 12 10:51:39 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 248/759] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:51:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-48ab2bed-c8ed-49a0-b9a8-1540b2cf43e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:51:41 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-48ab2bed-c8ed-49a0-b9a8-1540b2cf43e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-48ab2bed-c8ed-49a0-b9a8-1540b2cf43e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-48ab2bed-c8ed-49a0-b9a8-1540b2cf43e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-48ab2bed-c8ed-49a0-b9a8-1540b2cf43e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-48ab2bed-c8ed-49a0-b9a8-1540b2cf43e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-48ab2bed-c8ed-49a0-b9a8-1540b2cf43e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-48ab2bed-c8ed-49a0-b9a8-1540b2cf43e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-48ab2bed-c8ed-49a0-b9a8-1540b2cf43e7 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.162361 Apr 12 10:51:41 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 259/760] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 10:51:41 2023] GET /compute/v2.1/servers/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/os-interface => generated 282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:41 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-a18a0b93-d15f-4ec8-bce2-483dfe10dacb req-9c370b82-af66-4b72-98ca-c7896843cf4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76758da6-ef8f-433f-b4e8-8d72f01b6b34", "name": "network-vif-plugged", "status": "completed", "tag": "65d96800-cdfa-49fe-a407-05d5b661f452"}, {"server_uuid": "76758da6-ef8f-433f-b4e8-8d72f01b6b34", "name": "network-vif-deleted", "tag": "65d96800-cdfa-49fe-a407-05d5b661f452"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-a18a0b93-d15f-4ec8-bce2-483dfe10dacb req-9c370b82-af66-4b72-98ca-c7896843cf4a service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-a18a0b93-d15f-4ec8-bce2-483dfe10dacb req-9c370b82-af66-4b72-98ca-c7896843cf4a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-a18a0b93-d15f-4ec8-bce2-483dfe10dacb req-9c370b82-af66-4b72-98ca-c7896843cf4a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:42 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-a18a0b93-d15f-4ec8-bce2-483dfe10dacb req-9c370b82-af66-4b72-98ca-c7896843cf4a service nova] Creating event network-vif-plugged:65d96800-cdfa-49fe-a407-05d5b661f452 for instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 on user Apr 12 10:51:42 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-a18a0b93-d15f-4ec8-bce2-483dfe10dacb req-9c370b82-af66-4b72-98ca-c7896843cf4a service nova] Creating event network-vif-deleted:65d96800-cdfa-49fe-a407-05d5b661f452 for instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 on user Apr 12 10:51:42 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-a18a0b93-d15f-4ec8-bce2-483dfe10dacb req-9c370b82-af66-4b72-98ca-c7896843cf4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031940 Apr 12 10:51:42 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 254/761] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:51:41 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:42 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-0b0729b3-eaab-46a3-a756-e46f5a4a7353 req-e6476fcc-ad70-4174-aed9-35f060ba324d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23", "tag": "59e0f8a4-966b-46f3-921d-be0c6f15f281"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0b0729b3-eaab-46a3-a756-e46f5a4a7353 req-e6476fcc-ad70-4174-aed9-35f060ba324d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0b0729b3-eaab-46a3-a756-e46f5a4a7353 req-e6476fcc-ad70-4174-aed9-35f060ba324d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0b0729b3-eaab-46a3-a756-e46f5a4a7353 req-e6476fcc-ad70-4174-aed9-35f060ba324d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-0b0729b3-eaab-46a3-a756-e46f5a4a7353 req-e6476fcc-ad70-4174-aed9-35f060ba324d service nova] Creating event network-changed:59e0f8a4-966b-46f3-921d-be0c6f15f281 for instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 on user Apr 12 10:51:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-0b0729b3-eaab-46a3-a756-e46f5a4a7353 req-e6476fcc-ad70-4174-aed9-35f060ba324d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087050 Apr 12 10:51:42 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 249/762] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:51:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:45 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-465944081", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "f246d51a-9d0f-483e-858e-7f71be8b6085"}], "security_groups": [{"name": "tempest-securitygroup--2109462499"}], "key_name": "tempest-keypair-1241183546", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "aa22aac8-82c0-4487-bc15-af046a4aa2b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:45 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] validate_networks() for [('f246d51a-9d0f-483e-858e-7f71be8b6085', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:51:45 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:51:45 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:51:45 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:51:45 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:51:45 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:51:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:45 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:45 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting quotas for project 32235c67d269474b879a58269c1bfb28. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:51:45 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting quotas for user 0059d31539304ffcb5214b408751cd4f and project 32235c67d269474b879a58269c1bfb28. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:51:45 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:51:45 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aa22aac8-82c0-4487-bc15-af046a4aa2b4',volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:51:46 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.679954 Apr 12 10:51:46 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 260/763] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:51:45 2023] POST /compute/v2.1/servers => generated 404 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:51:46 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-f204a1df-a025-4f4d-bb30-d02ae5739930 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:51:46 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-f204a1df-a025-4f4d-bb30-d02ae5739930 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:46 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-f204a1df-a025-4f4d-bb30-d02ae5739930 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:51:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-f204a1df-a025-4f4d-bb30-d02ae5739930 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136" status: 200 len: 1075 microversion: 2.1 time: 0.074689 Apr 12 10:51:46 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 255/764] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:51:46 2023] GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136 => generated 1075 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:51:48 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-cc883d25-7540-4191-b29f-ded2da0ec14b req-fc145c34-183f-425f-b910-0a7bf5510219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cb22a78-94df-49fb-918c-32856e1b5136", "tag": "225efc65-26fe-4d54-93aa-35298d6ddd3f"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cc883d25-7540-4191-b29f-ded2da0ec14b req-fc145c34-183f-425f-b910-0a7bf5510219 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cc883d25-7540-4191-b29f-ded2da0ec14b req-fc145c34-183f-425f-b910-0a7bf5510219 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:48 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cc883d25-7540-4191-b29f-ded2da0ec14b req-fc145c34-183f-425f-b910-0a7bf5510219 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:48 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-cc883d25-7540-4191-b29f-ded2da0ec14b req-fc145c34-183f-425f-b910-0a7bf5510219 service nova] Creating event network-changed:225efc65-26fe-4d54-93aa-35298d6ddd3f for instance 0cb22a78-94df-49fb-918c-32856e1b5136 on user Apr 12 10:51:48 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-cc883d25-7540-4191-b29f-ded2da0ec14b req-fc145c34-183f-425f-b910-0a7bf5510219 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105663 Apr 12 10:51:48 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 250/765] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:51:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:51:54 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-7489bf26-60fe-4139-8484-84ca06c43484 req-10eff2ab-0c28-4b84-9338-a0e859af7fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb22a78-94df-49fb-918c-32856e1b5136", "name": "network-vif-plugged", "status": "completed", "tag": "225efc65-26fe-4d54-93aa-35298d6ddd3f"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7489bf26-60fe-4139-8484-84ca06c43484 req-10eff2ab-0c28-4b84-9338-a0e859af7fea service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7489bf26-60fe-4139-8484-84ca06c43484 req-10eff2ab-0c28-4b84-9338-a0e859af7fea service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7489bf26-60fe-4139-8484-84ca06c43484 req-10eff2ab-0c28-4b84-9338-a0e859af7fea service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-7489bf26-60fe-4139-8484-84ca06c43484 req-10eff2ab-0c28-4b84-9338-a0e859af7fea service nova] Creating event network-vif-plugged:225efc65-26fe-4d54-93aa-35298d6ddd3f for instance 0cb22a78-94df-49fb-918c-32856e1b5136 on user Apr 12 10:51:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-7489bf26-60fe-4139-8484-84ca06c43484 req-10eff2ab-0c28-4b84-9338-a0e859af7fea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037536 Apr 12 10:51:54 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 261/766] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:51:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:56 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=8 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:56 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=8 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:56 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:56 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-8b41c5fe-7b4e-4249-93ed-7517a8971964 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:51:56 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-8b41c5fe-7b4e-4249-93ed-7517a8971964 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8b41c5fe-7b4e-4249-93ed-7517a8971964 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8b41c5fe-7b4e-4249-93ed-7517a8971964 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8b41c5fe-7b4e-4249-93ed-7517a8971964 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8b41c5fe-7b4e-4249-93ed-7517a8971964 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8b41c5fe-7b4e-4249-93ed-7517a8971964 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8b41c5fe-7b4e-4249-93ed-7517a8971964 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:56 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-8b41c5fe-7b4e-4249-93ed-7517a8971964 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:51:56 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-8b41c5fe-7b4e-4249-93ed-7517a8971964 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" status: 200 len: 1550 microversion: 2.1 time: 0.149014 Apr 12 10:51:56 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 256/767] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:51:56 2023] GET /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 => generated 1550 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:51:56 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-cd171b96-10ab-4ef7-ad48-14821f6027bd req-45d7d739-71ea-4fd9-b804-08d7ee5de1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb22a78-94df-49fb-918c-32856e1b5136", "name": "network-vif-plugged", "status": "completed", "tag": "225efc65-26fe-4d54-93aa-35298d6ddd3f"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:51:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cd171b96-10ab-4ef7-ad48-14821f6027bd req-45d7d739-71ea-4fd9-b804-08d7ee5de1c7 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cd171b96-10ab-4ef7-ad48-14821f6027bd req-45d7d739-71ea-4fd9-b804-08d7ee5de1c7 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-cd171b96-10ab-4ef7-ad48-14821f6027bd req-45d7d739-71ea-4fd9-b804-08d7ee5de1c7 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-cd171b96-10ab-4ef7-ad48-14821f6027bd req-45d7d739-71ea-4fd9-b804-08d7ee5de1c7 service nova] Creating event network-vif-plugged:225efc65-26fe-4d54-93aa-35298d6ddd3f for instance 0cb22a78-94df-49fb-918c-32856e1b5136 on user Apr 12 10:51:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-cd171b96-10ab-4ef7-ad48-14821f6027bd req-45d7d739-71ea-4fd9-b804-08d7ee5de1c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032802 Apr 12 10:51:56 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 251/768] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:51:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:51:58 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:58 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:51:58 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5ae017e9-a76a-4897-884e-3e64d71a14b3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:51:58 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-5ae017e9-a76a-4897-884e-3e64d71a14b3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:51:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5ae017e9-a76a-4897-884e-3e64d71a14b3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5ae017e9-a76a-4897-884e-3e64d71a14b3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5ae017e9-a76a-4897-884e-3e64d71a14b3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5ae017e9-a76a-4897-884e-3e64d71a14b3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:51:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5ae017e9-a76a-4897-884e-3e64d71a14b3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:51:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5ae017e9-a76a-4897-884e-3e64d71a14b3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:51:58 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-5ae017e9-a76a-4897-884e-3e64d71a14b3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:51:58 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5ae017e9-a76a-4897-884e-3e64d71a14b3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc" status: 200 len: 1536 microversion: 2.1 time: 0.164843 Apr 12 10:51:58 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 262/769] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:51:58 2023] GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc => generated 1536 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:52:09 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:09 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:09 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-968185d3-0fc7-415e-ae21-72058b42dbed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:09 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-968185d3-0fc7-415e-ae21-72058b42dbed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-968185d3-0fc7-415e-ae21-72058b42dbed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-968185d3-0fc7-415e-ae21-72058b42dbed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-968185d3-0fc7-415e-ae21-72058b42dbed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-968185d3-0fc7-415e-ae21-72058b42dbed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-968185d3-0fc7-415e-ae21-72058b42dbed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-968185d3-0fc7-415e-ae21-72058b42dbed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:09 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-968185d3-0fc7-415e-ae21-72058b42dbed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044162 Apr 12 10:52:09 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 257/770] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:52:09 2023] GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 10:52:09 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=10 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:09 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=14 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:09 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:09 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:09 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:52:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7" status: 204 len: 0 microversion: 2.1 time: 0.118681 Apr 12 10:52:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 252/771] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:52:09 2023] DELETE /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:52:09 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f6a52837-8f64-4d6b-a536-c966ab5b56b6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:09 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f6a52837-8f64-4d6b-a536-c966ab5b56b6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:09 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:09 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f6a52837-8f64-4d6b-a536-c966ab5b56b6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f6a52837-8f64-4d6b-a536-c966ab5b56b6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f6a52837-8f64-4d6b-a536-c966ab5b56b6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f6a52837-8f64-4d6b-a536-c966ab5b56b6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f6a52837-8f64-4d6b-a536-c966ab5b56b6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f6a52837-8f64-4d6b-a536-c966ab5b56b6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:09 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-f6a52837-8f64-4d6b-a536-c966ab5b56b6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec47d3cdacb45e5a39509e76b546e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cecbfbfd5f42dbb663367f6fbdf3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:52:09 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f6a52837-8f64-4d6b-a536-c966ab5b56b6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7" status: 200 len: 1669 microversion: 2.1 time: 0.209758 Apr 12 10:52:09 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 263/772] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:52:09 2023] GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7 => generated 1669 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:52:09 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-e5a70629-b694-495d-8fe7-e453e34f6559 req-da6b59f3-f605-4653-b4d7-577e40f3d25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ea43d4-f2b9-4665-b1c9-412367e2b4d7", "name": "network-vif-unplugged", "status": "completed", "tag": "a41db5a9-2805-455d-b27e-72e11d4f1012"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:52:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e5a70629-b694-495d-8fe7-e453e34f6559 req-da6b59f3-f605-4653-b4d7-577e40f3d25d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e5a70629-b694-495d-8fe7-e453e34f6559 req-da6b59f3-f605-4653-b4d7-577e40f3d25d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-e5a70629-b694-495d-8fe7-e453e34f6559 req-da6b59f3-f605-4653-b4d7-577e40f3d25d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:09 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-e5a70629-b694-495d-8fe7-e453e34f6559 req-da6b59f3-f605-4653-b4d7-577e40f3d25d service nova] Creating event network-vif-unplugged:a41db5a9-2805-455d-b27e-72e11d4f1012 for instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 on user Apr 12 10:52:09 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-e5a70629-b694-495d-8fe7-e453e34f6559 req-da6b59f3-f605-4653-b4d7-577e40f3d25d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052023 Apr 12 10:52:09 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 258/773] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:52:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:52:10 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0609ac24-689a-46e0-a3e9-07a052c1b879 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:10 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-0609ac24-689a-46e0-a3e9-07a052c1b879 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0609ac24-689a-46e0-a3e9-07a052c1b879 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0609ac24-689a-46e0-a3e9-07a052c1b879 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0609ac24-689a-46e0-a3e9-07a052c1b879 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0609ac24-689a-46e0-a3e9-07a052c1b879 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0609ac24-689a-46e0-a3e9-07a052c1b879 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0609ac24-689a-46e0-a3e9-07a052c1b879 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:10 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-0609ac24-689a-46e0-a3e9-07a052c1b879 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:52:10 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-0609ac24-689a-46e0-a3e9-07a052c1b879 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22" status: 200 len: 1554 microversion: 2.1 time: 0.201120 Apr 12 10:52:10 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 253/774] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:52:10 2023] GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22 => generated 1554 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:52:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-f33dd160-18cd-4ea6-86df-e910fb380f87 req-4004428e-bd53-446a-ba4a-3ca956e303d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ea43d4-f2b9-4665-b1c9-412367e2b4d7", "name": "network-vif-plugged", "status": "completed", "tag": "a41db5a9-2805-455d-b27e-72e11d4f1012"}, {"server_uuid": "82ea43d4-f2b9-4665-b1c9-412367e2b4d7", "name": "network-vif-deleted", "tag": "a41db5a9-2805-455d-b27e-72e11d4f1012"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:52:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f33dd160-18cd-4ea6-86df-e910fb380f87 req-4004428e-bd53-446a-ba4a-3ca956e303d7 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f33dd160-18cd-4ea6-86df-e910fb380f87 req-4004428e-bd53-446a-ba4a-3ca956e303d7 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f33dd160-18cd-4ea6-86df-e910fb380f87 req-4004428e-bd53-446a-ba4a-3ca956e303d7 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f33dd160-18cd-4ea6-86df-e910fb380f87 req-4004428e-bd53-446a-ba4a-3ca956e303d7 service nova] Creating event network-vif-plugged:a41db5a9-2805-455d-b27e-72e11d4f1012 for instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 on user Apr 12 10:52:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f33dd160-18cd-4ea6-86df-e910fb380f87 req-4004428e-bd53-446a-ba4a-3ca956e303d7 service nova] Creating event network-vif-deleted:a41db5a9-2805-455d-b27e-72e11d4f1012 for instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 on user Apr 12 10:52:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-f33dd160-18cd-4ea6-86df-e910fb380f87 req-4004428e-bd53-446a-ba4a-3ca956e303d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033773 Apr 12 10:52:11 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 264/775] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:52:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:52:26 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:26 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=8 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:26 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:26 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:26 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:26 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:52:27 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" status: 204 len: 0 microversion: 2.87 time: 0.255441 Apr 12 10:52:27 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 259/776] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 10:52:26 2023] DELETE /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 10:52:27 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-085737fd-62ab-4626-a223-100c076bb9ab tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:27 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-085737fd-62ab-4626-a223-100c076bb9ab tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:27 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:27 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-085737fd-62ab-4626-a223-100c076bb9ab tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-085737fd-62ab-4626-a223-100c076bb9ab tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-085737fd-62ab-4626-a223-100c076bb9ab tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-085737fd-62ab-4626-a223-100c076bb9ab tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-085737fd-62ab-4626-a223-100c076bb9ab tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-085737fd-62ab-4626-a223-100c076bb9ab tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:27 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-085737fd-62ab-4626-a223-100c076bb9ab tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:52:27 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-085737fd-62ab-4626-a223-100c076bb9ab tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:52:27 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:27 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-085737fd-62ab-4626-a223-100c076bb9ab tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:52:27 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=8 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:27 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-085737fd-62ab-4626-a223-100c076bb9ab tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" status: 200 len: 1773 microversion: 2.87 time: 0.233582 Apr 12 10:52:27 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 254/777] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:52:27 2023] GET /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa => generated 1773 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:52:27 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-25bf1245-d337-4903-ab2f-af7dcf9b3adb req-04ffa8e4-8be5-4a00-8636-b93eae748009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa", "name": "network-vif-unplugged", "status": "completed", "tag": "48ecbe51-c168-45fd-9029-d5cfa270e5c5"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:52:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-25bf1245-d337-4903-ab2f-af7dcf9b3adb req-04ffa8e4-8be5-4a00-8636-b93eae748009 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-25bf1245-d337-4903-ab2f-af7dcf9b3adb req-04ffa8e4-8be5-4a00-8636-b93eae748009 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-25bf1245-d337-4903-ab2f-af7dcf9b3adb req-04ffa8e4-8be5-4a00-8636-b93eae748009 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:27 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-25bf1245-d337-4903-ab2f-af7dcf9b3adb req-04ffa8e4-8be5-4a00-8636-b93eae748009 service nova] Creating event network-vif-unplugged:48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa on user Apr 12 10:52:27 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-25bf1245-d337-4903-ab2f-af7dcf9b3adb req-04ffa8e4-8be5-4a00-8636-b93eae748009 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051673 Apr 12 10:52:27 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 265/778] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:52:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:52:29 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-948d322c-927a-4261-8794-71d807885c5d req-24376f0c-e836-47d6-80e0-fa39b8d66a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa", "name": "network-vif-plugged", "status": "completed", "tag": "48ecbe51-c168-45fd-9029-d5cfa270e5c5"}, {"server_uuid": "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa", "name": "network-vif-deleted", "tag": "48ecbe51-c168-45fd-9029-d5cfa270e5c5"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:52:29 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-948d322c-927a-4261-8794-71d807885c5d req-24376f0c-e836-47d6-80e0-fa39b8d66a7c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:29 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-948d322c-927a-4261-8794-71d807885c5d req-24376f0c-e836-47d6-80e0-fa39b8d66a7c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:29 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-948d322c-927a-4261-8794-71d807885c5d req-24376f0c-e836-47d6-80e0-fa39b8d66a7c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:29 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-948d322c-927a-4261-8794-71d807885c5d req-24376f0c-e836-47d6-80e0-fa39b8d66a7c service nova] Creating event network-vif-plugged:48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa on user Apr 12 10:52:29 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-948d322c-927a-4261-8794-71d807885c5d req-24376f0c-e836-47d6-80e0-fa39b8d66a7c service nova] Creating event network-vif-deleted:48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa on user Apr 12 10:52:29 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-948d322c-927a-4261-8794-71d807885c5d req-24376f0c-e836-47d6-80e0-fa39b8d66a7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031443 Apr 12 10:52:29 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 260/779] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:52:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:52:29 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b13031b0-142a-462e-b1ce-30de86d0f1eb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:29 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b13031b0-142a-462e-b1ce-30de86d0f1eb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b13031b0-142a-462e-b1ce-30de86d0f1eb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b13031b0-142a-462e-b1ce-30de86d0f1eb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b13031b0-142a-462e-b1ce-30de86d0f1eb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b13031b0-142a-462e-b1ce-30de86d0f1eb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b13031b0-142a-462e-b1ce-30de86d0f1eb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b13031b0-142a-462e-b1ce-30de86d0f1eb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-b13031b0-142a-462e-b1ce-30de86d0f1eb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] HTTP exception thrown: Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 could not be found. Apr 12 10:52:29 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b13031b0-142a-462e-b1ce-30de86d0f1eb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Request method failure captured: Apr 12 10:52:29 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34 HTTP/1.1 Apr 12 10:52:29 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:52:29 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:52:29 user devstack@n-api.service[61853]: Connection: close Apr 12 10:52:29 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:52:29 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:52:29 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:52:29 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:52:29 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:52:29 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNoouXVke4zrMP32TCbioIDUNa_DANk_XHzEmTqZotQork8HQI_cIXAMStkpweTbFN8OQdblBuuvjAsmiUW6DL7s_CNKxsp1Z5jZn_yTLRkDwFXP9F4-RCkbzC6peGvy2Nq9E-ebBh6b_bbwxu7VnP3XdBmxCiiEqhh1z2faBd-lIB8M Apr 12 10:52:29 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:52:29 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:52:29 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:52:29 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:52:29 user devstack@n-api.service[61853]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 10:52:29 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:52:29 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:52:29 user devstack@n-api.service[61853]: X-Project-Id: af33ce0944194932b663c3b8aef9783d Apr 12 10:52:29 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-603525697 Apr 12 10:52:29 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:52:29 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:52:29 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/af33ce0944194932b663c3b8aef9783d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af33ce0944194932b663c3b8aef9783d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af33ce0944194932b663c3b8aef9783d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:52:29 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeShelveTestJSON-603525697 Apr 12 10:52:29 user devstack@n-api.service[61853]: X-Tenant-Id: af33ce0944194932b663c3b8aef9783d Apr 12 10:52:29 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-603525697 Apr 12 10:52:29 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeShelveTestJSON-603525697-project-member Apr 12 10:52:29 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:52:29 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:52:29 user devstack@n-api.service[61853]: X-User-Id: 47d6279f1ce94008a2898ade6f730b40 Apr 12 10:52:29 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeShelveTestJSON-603525697-project-member Apr 12 10:52:29 user devstack@n-api.service[61853]: method: > Apr 12 10:52:29 user devstack@n-api.service[61853]: exception: Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 could not be found. Apr 12 10:52:29 user devstack@n-api.service[61853]: action_args: {'id': '76758da6-ef8f-433f-b4e8-8d72f01b6b34'} Apr 12 10:52:29 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 could not be found. Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 could not be found. Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 could not be found. Apr 12 10:52:29 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:52:29 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b13031b0-142a-462e-b1ce-30de86d0f1eb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Returning 404 to user: Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:52:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b13031b0-142a-462e-b1ce-30de86d0f1eb tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34" status: 404 len: 111 microversion: 2.20 time: 0.027955 Apr 12 10:52:29 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 255/780] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:52:29 2023] GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:52:29 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-57142a1b-a786-451b-b026-9a20ef09d3ca tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '.version_select at 0x7fabbf6a4ee0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-57142a1b-a786-451b-b026-9a20ef09d3ca tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-538398767" status: 204 len: 0 microversion: 2.20 time: 0.025987 Apr 12 10:52:29 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 266/781] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 10:52:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-538398767 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 10:52:32 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-d9d137ea-7691-4e52-ba06-3f2b4205cf45 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:32 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-d9d137ea-7691-4e52-ba06-3f2b4205cf45 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9d137ea-7691-4e52-ba06-3f2b4205cf45 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9d137ea-7691-4e52-ba06-3f2b4205cf45 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9d137ea-7691-4e52-ba06-3f2b4205cf45 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9d137ea-7691-4e52-ba06-3f2b4205cf45 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9d137ea-7691-4e52-ba06-3f2b4205cf45 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d9d137ea-7691-4e52-ba06-3f2b4205cf45 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:32 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-d9d137ea-7691-4e52-ba06-3f2b4205cf45 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] HTTP exception thrown: Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 could not be found. Apr 12 10:52:32 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-d9d137ea-7691-4e52-ba06-3f2b4205cf45 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Request method failure captured: Apr 12 10:52:32 user devstack@n-api.service[61852]: request: DELETE /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34 HTTP/1.1 Apr 12 10:52:32 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:52:32 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:52:32 user devstack@n-api.service[61852]: Connection: close Apr 12 10:52:32 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:52:32 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:52:32 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:52:32 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:52:32 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:52:32 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNoouXVke4zrMP32TCbioIDUNa_DANk_XHzEmTqZotQork8HQI_cIXAMStkpweTbFN8OQdblBuuvjAsmiUW6DL7s_CNKxsp1Z5jZn_yTLRkDwFXP9F4-RCkbzC6peGvy2Nq9E-ebBh6b_bbwxu7VnP3XdBmxCiiEqhh1z2faBd-lIB8M Apr 12 10:52:32 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:52:32 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:52:32 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:52:32 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:52:32 user devstack@n-api.service[61852]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 10:52:32 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:52:32 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:52:32 user devstack@n-api.service[61852]: X-Project-Id: af33ce0944194932b663c3b8aef9783d Apr 12 10:52:32 user devstack@n-api.service[61852]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-603525697 Apr 12 10:52:32 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:52:32 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:52:32 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/af33ce0944194932b663c3b8aef9783d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af33ce0944194932b663c3b8aef9783d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af33ce0944194932b663c3b8aef9783d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:52:32 user devstack@n-api.service[61852]: X-Tenant: tempest-AttachVolumeShelveTestJSON-603525697 Apr 12 10:52:32 user devstack@n-api.service[61852]: X-Tenant-Id: af33ce0944194932b663c3b8aef9783d Apr 12 10:52:32 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-603525697 Apr 12 10:52:32 user devstack@n-api.service[61852]: X-User: tempest-AttachVolumeShelveTestJSON-603525697-project-member Apr 12 10:52:32 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:52:32 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:52:32 user devstack@n-api.service[61852]: X-User-Id: 47d6279f1ce94008a2898ade6f730b40 Apr 12 10:52:32 user devstack@n-api.service[61852]: X-User-Name: tempest-AttachVolumeShelveTestJSON-603525697-project-member Apr 12 10:52:32 user devstack@n-api.service[61852]: method: > Apr 12 10:52:32 user devstack@n-api.service[61852]: exception: Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 could not be found. Apr 12 10:52:32 user devstack@n-api.service[61852]: action_args: {'id': '76758da6-ef8f-433f-b4e8-8d72f01b6b34'} Apr 12 10:52:32 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 could not be found. Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 could not be found. Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 could not be found. Apr 12 10:52:32 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:52:32 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-d9d137ea-7691-4e52-ba06-3f2b4205cf45 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Returning 404 to user: Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:52:32 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-d9d137ea-7691-4e52-ba06-3f2b4205cf45 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34" status: 404 len: 111 microversion: 2.20 time: 0.034683 Apr 12 10:52:32 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 261/782] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 10:52:32 2023] DELETE /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:52:32 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-75f3b039-29a0-4b79-92ac-f91324faaafa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:32 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-75f3b039-29a0-4b79-92ac-f91324faaafa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-75f3b039-29a0-4b79-92ac-f91324faaafa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-75f3b039-29a0-4b79-92ac-f91324faaafa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-75f3b039-29a0-4b79-92ac-f91324faaafa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-75f3b039-29a0-4b79-92ac-f91324faaafa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-75f3b039-29a0-4b79-92ac-f91324faaafa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:32 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-75f3b039-29a0-4b79-92ac-f91324faaafa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:32 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-75f3b039-29a0-4b79-92ac-f91324faaafa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] HTTP exception thrown: Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 could not be found. Apr 12 10:52:32 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-75f3b039-29a0-4b79-92ac-f91324faaafa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Request method failure captured: Apr 12 10:52:32 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34 HTTP/1.1 Apr 12 10:52:32 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:52:32 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:52:32 user devstack@n-api.service[61853]: Connection: close Apr 12 10:52:32 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:52:32 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:52:32 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:52:32 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:52:32 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:52:32 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNoouXVke4zrMP32TCbioIDUNa_DANk_XHzEmTqZotQork8HQI_cIXAMStkpweTbFN8OQdblBuuvjAsmiUW6DL7s_CNKxsp1Z5jZn_yTLRkDwFXP9F4-RCkbzC6peGvy2Nq9E-ebBh6b_bbwxu7VnP3XdBmxCiiEqhh1z2faBd-lIB8M Apr 12 10:52:32 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:52:32 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:52:32 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:52:32 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:52:32 user devstack@n-api.service[61853]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 10:52:32 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:52:32 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:52:32 user devstack@n-api.service[61853]: X-Project-Id: af33ce0944194932b663c3b8aef9783d Apr 12 10:52:32 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-603525697 Apr 12 10:52:32 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:52:32 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:52:32 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/af33ce0944194932b663c3b8aef9783d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af33ce0944194932b663c3b8aef9783d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af33ce0944194932b663c3b8aef9783d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:52:32 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeShelveTestJSON-603525697 Apr 12 10:52:32 user devstack@n-api.service[61853]: X-Tenant-Id: af33ce0944194932b663c3b8aef9783d Apr 12 10:52:32 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-603525697 Apr 12 10:52:32 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeShelveTestJSON-603525697-project-member Apr 12 10:52:32 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:52:32 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:52:32 user devstack@n-api.service[61853]: X-User-Id: 47d6279f1ce94008a2898ade6f730b40 Apr 12 10:52:32 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeShelveTestJSON-603525697-project-member Apr 12 10:52:32 user devstack@n-api.service[61853]: method: > Apr 12 10:52:32 user devstack@n-api.service[61853]: exception: Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 could not be found. Apr 12 10:52:32 user devstack@n-api.service[61853]: action_args: {'id': '76758da6-ef8f-433f-b4e8-8d72f01b6b34'} Apr 12 10:52:32 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 could not be found. Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 could not be found. Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 could not be found. Apr 12 10:52:32 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:52:32 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-75f3b039-29a0-4b79-92ac-f91324faaafa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Returning 404 to user: Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:52:32 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-75f3b039-29a0-4b79-92ac-f91324faaafa tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34" status: 404 len: 111 microversion: 2.20 time: 0.032910 Apr 12 10:52:32 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 256/783] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:52:32 2023] GET /compute/v2.1/servers/76758da6-ef8f-433f-b4e8-8d72f01b6b34 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:52:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-c5c69a70-c982-4ea3-ba65-68bfbc4d1a62 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:35 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-c5c69a70-c982-4ea3-ba65-68bfbc4d1a62 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c5c69a70-c982-4ea3-ba65-68bfbc4d1a62 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c5c69a70-c982-4ea3-ba65-68bfbc4d1a62 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c5c69a70-c982-4ea3-ba65-68bfbc4d1a62 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c5c69a70-c982-4ea3-ba65-68bfbc4d1a62 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c5c69a70-c982-4ea3-ba65-68bfbc4d1a62 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c5c69a70-c982-4ea3-ba65-68bfbc4d1a62 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-c5c69a70-c982-4ea3-ba65-68bfbc4d1a62 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] HTTP exception thrown: Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa could not be found. Apr 12 10:52:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-c5c69a70-c982-4ea3-ba65-68bfbc4d1a62 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Request method failure captured: Apr 12 10:52:35 user devstack@n-api.service[61854]: request: DELETE /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa HTTP/1.1 Apr 12 10:52:35 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:52:35 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:52:35 user devstack@n-api.service[61854]: Connection: close Apr 12 10:52:35 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:52:35 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:52:35 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:52:35 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:52:35 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:52:35 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNoouXVke4zrMP32TCbioIDUNa_DANk_XHzEmTqZotQork8HQI_cIXAMStkpweTbFN8OQdblBuuvjAsmiUW6DL7s_CNKxsp1Z5jZn_yTLRkDwFXP9F4-RCkbzC6peGvy2Nq9E-ebBh6b_bbwxu7VnP3XdBmxCiiEqhh1z2faBd-lIB8M Apr 12 10:52:35 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:52:35 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:52:35 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:52:35 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:52:35 user devstack@n-api.service[61854]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 10:52:35 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:52:35 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:52:35 user devstack@n-api.service[61854]: X-Project-Id: af33ce0944194932b663c3b8aef9783d Apr 12 10:52:35 user devstack@n-api.service[61854]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-603525697 Apr 12 10:52:35 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:52:35 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:52:35 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/af33ce0944194932b663c3b8aef9783d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af33ce0944194932b663c3b8aef9783d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af33ce0944194932b663c3b8aef9783d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:52:35 user devstack@n-api.service[61854]: X-Tenant: tempest-AttachVolumeShelveTestJSON-603525697 Apr 12 10:52:35 user devstack@n-api.service[61854]: X-Tenant-Id: af33ce0944194932b663c3b8aef9783d Apr 12 10:52:35 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-603525697 Apr 12 10:52:35 user devstack@n-api.service[61854]: X-User: tempest-AttachVolumeShelveTestJSON-603525697-project-member Apr 12 10:52:35 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:52:35 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:52:35 user devstack@n-api.service[61854]: X-User-Id: 47d6279f1ce94008a2898ade6f730b40 Apr 12 10:52:35 user devstack@n-api.service[61854]: X-User-Name: tempest-AttachVolumeShelveTestJSON-603525697-project-member Apr 12 10:52:35 user devstack@n-api.service[61854]: method: > Apr 12 10:52:35 user devstack@n-api.service[61854]: exception: Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa could not be found. Apr 12 10:52:35 user devstack@n-api.service[61854]: action_args: {'id': '0bfafa79-ce40-42f1-9992-10e50734f7fa'} Apr 12 10:52:35 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa could not be found. Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa could not be found. Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa could not be found. Apr 12 10:52:35 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:52:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-c5c69a70-c982-4ea3-ba65-68bfbc4d1a62 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Returning 404 to user: Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:52:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-c5c69a70-c982-4ea3-ba65-68bfbc4d1a62 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa" status: 404 len: 111 microversion: 2.20 time: 0.033309 Apr 12 10:52:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 267/784] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 10:52:35 2023] DELETE /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:52:35 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-4f475e62-e839-4dd4-b95a-7b1193d89add tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:35 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-4f475e62-e839-4dd4-b95a-7b1193d89add tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4f475e62-e839-4dd4-b95a-7b1193d89add tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4f475e62-e839-4dd4-b95a-7b1193d89add tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4f475e62-e839-4dd4-b95a-7b1193d89add tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4f475e62-e839-4dd4-b95a-7b1193d89add tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4f475e62-e839-4dd4-b95a-7b1193d89add tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-4f475e62-e839-4dd4-b95a-7b1193d89add tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-4f475e62-e839-4dd4-b95a-7b1193d89add tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] HTTP exception thrown: Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa could not be found. Apr 12 10:52:35 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-4f475e62-e839-4dd4-b95a-7b1193d89add tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Request method failure captured: Apr 12 10:52:35 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa HTTP/1.1 Apr 12 10:52:35 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:52:35 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:52:35 user devstack@n-api.service[61852]: Connection: close Apr 12 10:52:35 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:52:35 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:52:35 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:52:35 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:52:35 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:52:35 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNoouXVke4zrMP32TCbioIDUNa_DANk_XHzEmTqZotQork8HQI_cIXAMStkpweTbFN8OQdblBuuvjAsmiUW6DL7s_CNKxsp1Z5jZn_yTLRkDwFXP9F4-RCkbzC6peGvy2Nq9E-ebBh6b_bbwxu7VnP3XdBmxCiiEqhh1z2faBd-lIB8M Apr 12 10:52:35 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:52:35 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:52:35 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:52:35 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:52:35 user devstack@n-api.service[61852]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 10:52:35 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:52:35 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:52:35 user devstack@n-api.service[61852]: X-Project-Id: af33ce0944194932b663c3b8aef9783d Apr 12 10:52:35 user devstack@n-api.service[61852]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-603525697 Apr 12 10:52:35 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:52:35 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:52:35 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/af33ce0944194932b663c3b8aef9783d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af33ce0944194932b663c3b8aef9783d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af33ce0944194932b663c3b8aef9783d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:52:35 user devstack@n-api.service[61852]: X-Tenant: tempest-AttachVolumeShelveTestJSON-603525697 Apr 12 10:52:35 user devstack@n-api.service[61852]: X-Tenant-Id: af33ce0944194932b663c3b8aef9783d Apr 12 10:52:35 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-603525697 Apr 12 10:52:35 user devstack@n-api.service[61852]: X-User: tempest-AttachVolumeShelveTestJSON-603525697-project-member Apr 12 10:52:35 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:52:35 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:52:35 user devstack@n-api.service[61852]: X-User-Id: 47d6279f1ce94008a2898ade6f730b40 Apr 12 10:52:35 user devstack@n-api.service[61852]: X-User-Name: tempest-AttachVolumeShelveTestJSON-603525697-project-member Apr 12 10:52:35 user devstack@n-api.service[61852]: method: > Apr 12 10:52:35 user devstack@n-api.service[61852]: exception: Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa could not be found. Apr 12 10:52:35 user devstack@n-api.service[61852]: action_args: {'id': '0bfafa79-ce40-42f1-9992-10e50734f7fa'} Apr 12 10:52:35 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa could not be found. Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa could not be found. Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa could not be found. Apr 12 10:52:35 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:52:35 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-4f475e62-e839-4dd4-b95a-7b1193d89add tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Returning 404 to user: Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:52:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-4f475e62-e839-4dd4-b95a-7b1193d89add tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa" status: 404 len: 111 microversion: 2.20 time: 0.032014 Apr 12 10:52:35 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 262/785] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:52:35 2023] GET /compute/v2.1/servers/0bfafa79-ce40-42f1-9992-10e50734f7fa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:52:36 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1ea51f28-2fb4-4302-b5e9-93c79f60e936 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:36 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-1ea51f28-2fb4-4302-b5e9-93c79f60e936 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ea51f28-2fb4-4302-b5e9-93c79f60e936 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ea51f28-2fb4-4302-b5e9-93c79f60e936 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ea51f28-2fb4-4302-b5e9-93c79f60e936 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ea51f28-2fb4-4302-b5e9-93c79f60e936 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ea51f28-2fb4-4302-b5e9-93c79f60e936 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:36 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1ea51f28-2fb4-4302-b5e9-93c79f60e936 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:36 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-1ea51f28-2fb4-4302-b5e9-93c79f60e936 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:52:36 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1ea51f28-2fb4-4302-b5e9-93c79f60e936 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136" status: 200 len: 1428 microversion: 2.1 time: 0.247992 Apr 12 10:52:36 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 257/786] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:52:36 2023] GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136 => generated 1428 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:52:45 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:45 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:45 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0c31825d-6b7d-4a81-a7e5-556b0bb54f7d tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Action: 'create', calling method: .version_select at 0x7fabbf6a49d0>, body: {"keypair": {"name": "tempest-keypair-1222347782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQLwZrl3jPnPhohKnRnR2qfd8ly9sETNwW4CsnbJ63gmB7R0QElmNz5jXYfSBpJs0XqGEZmxFm/4XJScQktvDrpb6FHDkQYZ7pSrXVh9P+kxqpboxMoLpeKxHkx0WwNzw=="}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:52:45 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-0c31825d-6b7d-4a81-a7e5-556b0bb54f7d tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Getting quotas for project 9878bfe34ceb4a6695b253ad161c4f7b. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:52:45 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-0c31825d-6b7d-4a81-a7e5-556b0bb54f7d tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Getting quotas for user f6576467073e41e9b497097d5a8dfd3d and project 9878bfe34ceb4a6695b253ad161c4f7b. Resources: {'key_pairs'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:52:45 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-0c31825d-6b7d-4a81-a7e5-556b0bb54f7d tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.170550 Apr 12 10:52:45 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 268/787] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 10:52:45 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1710761960", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "cd7a59d4-de6d-47fd-acf3-4304f60a460c"}], "security_groups": [{"name": "tempest-securitygroup--924840447"}], "key_name": "tempest-keypair-1222347782", "user_data": "}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG nova.network.neutron [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] validate_networks() for [('cd7a59d4-de6d-47fd-acf3-4304f60a460c', None, None, None, None, None)] {{(pid=61852) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Flavor limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Image limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Flavor pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Image pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Getting quotas for project 9878bfe34ceb4a6695b253ad161c4f7b. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Getting quotas for user f6576467073e41e9b497097d5a8dfd3d and project 9878bfe34ceb4a6695b253ad161c4f7b. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Going to run 1 instances... {{(pid=61852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:52:47 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:52:47 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.556432 Apr 12 10:52:47 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 263/788] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:52:47 2023] POST /compute/v2.1/servers => generated 399 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:52:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-9d3c92ee-f284-4960-9546-f87a6d3177fa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:47 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-9d3c92ee-f284-4960-9546-f87a6d3177fa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:47 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=10 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:47 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=16 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:47 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-9d3c92ee-f284-4960-9546-f87a6d3177fa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6576467073e41e9b497097d5a8dfd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9878bfe34ceb4a6695b253ad161c4f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:52:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-9d3c92ee-f284-4960-9546-f87a6d3177fa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644" status: 200 len: 1232 microversion: 2.1 time: 0.077344 Apr 12 10:52:47 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 258/789] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:52:47 2023] GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644 => generated 1232 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:52:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-66d99d0a-1fe9-4454-81c7-cf9c6582ff92 req-9d137822-b8cb-49af-85b7-b877f59f628b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aef35e7-5daf-4d41-b91b-a7ff4a481644", "tag": "8786a087-f036-403b-9b82-c75fc6dbb110"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:52:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-66d99d0a-1fe9-4454-81c7-cf9c6582ff92 req-9d137822-b8cb-49af-85b7-b877f59f628b service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-66d99d0a-1fe9-4454-81c7-cf9c6582ff92 req-9d137822-b8cb-49af-85b7-b877f59f628b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-66d99d0a-1fe9-4454-81c7-cf9c6582ff92 req-9d137822-b8cb-49af-85b7-b877f59f628b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-66d99d0a-1fe9-4454-81c7-cf9c6582ff92 req-9d137822-b8cb-49af-85b7-b877f59f628b service nova] Creating event network-changed:8786a087-f036-403b-9b82-c75fc6dbb110 for instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 on user Apr 12 10:52:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-66d99d0a-1fe9-4454-81c7-cf9c6582ff92 req-9d137822-b8cb-49af-85b7-b877f59f628b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032410 Apr 12 10:52:50 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 269/790] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:52:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:52:52 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-1fd709b6-4407-49a8-a0ff-64d2d7d4a677 req-0f1cf755-aacb-499f-bdc7-3df356cc936a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aef35e7-5daf-4d41-b91b-a7ff4a481644", "name": "network-vif-plugged", "status": "completed", "tag": "8786a087-f036-403b-9b82-c75fc6dbb110"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:52:52 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-1fd709b6-4407-49a8-a0ff-64d2d7d4a677 req-0f1cf755-aacb-499f-bdc7-3df356cc936a service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:52 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-1fd709b6-4407-49a8-a0ff-64d2d7d4a677 req-0f1cf755-aacb-499f-bdc7-3df356cc936a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:52 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-1fd709b6-4407-49a8-a0ff-64d2d7d4a677 req-0f1cf755-aacb-499f-bdc7-3df356cc936a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:52 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-1fd709b6-4407-49a8-a0ff-64d2d7d4a677 req-0f1cf755-aacb-499f-bdc7-3df356cc936a service nova] Creating event network-vif-plugged:8786a087-f036-403b-9b82-c75fc6dbb110 for instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 on user Apr 12 10:52:52 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-1fd709b6-4407-49a8-a0ff-64d2d7d4a677 req-0f1cf755-aacb-499f-bdc7-3df356cc936a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033436 Apr 12 10:52:52 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 264/791] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:52:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:52:54 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-6800f127-3053-4e8b-ac73-a9af75c5d2d1 req-35043720-8d0b-4bd5-89c1-e9bef7473d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aef35e7-5daf-4d41-b91b-a7ff4a481644", "name": "network-vif-plugged", "status": "completed", "tag": "8786a087-f036-403b-9b82-c75fc6dbb110"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:52:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6800f127-3053-4e8b-ac73-a9af75c5d2d1 req-35043720-8d0b-4bd5-89c1-e9bef7473d86 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6800f127-3053-4e8b-ac73-a9af75c5d2d1 req-35043720-8d0b-4bd5-89c1-e9bef7473d86 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6800f127-3053-4e8b-ac73-a9af75c5d2d1 req-35043720-8d0b-4bd5-89c1-e9bef7473d86 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:54 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-6800f127-3053-4e8b-ac73-a9af75c5d2d1 req-35043720-8d0b-4bd5-89c1-e9bef7473d86 service nova] Creating event network-vif-plugged:8786a087-f036-403b-9b82-c75fc6dbb110 for instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 on user Apr 12 10:52:54 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-6800f127-3053-4e8b-ac73-a9af75c5d2d1 req-35043720-8d0b-4bd5-89c1-e9bef7473d86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031794 Apr 12 10:52:54 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 259/792] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:52:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:52:56 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:56 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b0c6dc8c-8196-4074-b093-833aee94f973 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:56 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-b0c6dc8c-8196-4074-b093-833aee94f973 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b0c6dc8c-8196-4074-b093-833aee94f973 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b0c6dc8c-8196-4074-b093-833aee94f973 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b0c6dc8c-8196-4074-b093-833aee94f973 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b0c6dc8c-8196-4074-b093-833aee94f973 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b0c6dc8c-8196-4074-b093-833aee94f973 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:56 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b0c6dc8c-8196-4074-b093-833aee94f973 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:56 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-b0c6dc8c-8196-4074-b093-833aee94f973 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:52:56 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b0c6dc8c-8196-4074-b093-833aee94f973 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" status: 200 len: 1550 microversion: 2.1 time: 0.206865 Apr 12 10:52:56 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 270/793] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:52:56 2023] GET /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 => generated 1550 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:52:56 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:56 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:56 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:52:56 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" status: 204 len: 0 microversion: 2.1 time: 0.113524 Apr 12 10:52:56 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 265/794] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:52:56 2023] DELETE /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:52:56 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f3132807-201e-4690-948e-4086c154cb2f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:56 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f3132807-201e-4690-948e-4086c154cb2f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f3132807-201e-4690-948e-4086c154cb2f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f3132807-201e-4690-948e-4086c154cb2f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f3132807-201e-4690-948e-4086c154cb2f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f3132807-201e-4690-948e-4086c154cb2f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f3132807-201e-4690-948e-4086c154cb2f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f3132807-201e-4690-948e-4086c154cb2f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:57 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-f3132807-201e-4690-948e-4086c154cb2f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:52:57 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f3132807-201e-4690-948e-4086c154cb2f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" status: 200 len: 1556 microversion: 2.1 time: 0.235810 Apr 12 10:52:57 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 260/795] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:52:56 2023] GET /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 => generated 1556 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:52:57 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-53f079cf-a552-427e-9612-9ca3011b34e1 req-5ebb3edd-b9c5-4f21-8d12-aebfe6163064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8", "name": "network-vif-unplugged", "status": "completed", "tag": "2c64da14-81c7-48d5-b272-2e09127f33fd"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:52:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-53f079cf-a552-427e-9612-9ca3011b34e1 req-5ebb3edd-b9c5-4f21-8d12-aebfe6163064 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-53f079cf-a552-427e-9612-9ca3011b34e1 req-5ebb3edd-b9c5-4f21-8d12-aebfe6163064 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-53f079cf-a552-427e-9612-9ca3011b34e1 req-5ebb3edd-b9c5-4f21-8d12-aebfe6163064 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-53f079cf-a552-427e-9612-9ca3011b34e1 req-5ebb3edd-b9c5-4f21-8d12-aebfe6163064 service nova] Creating event network-vif-unplugged:2c64da14-81c7-48d5-b272-2e09127f33fd for instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 on user Apr 12 10:52:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-53f079cf-a552-427e-9612-9ca3011b34e1 req-5ebb3edd-b9c5-4f21-8d12-aebfe6163064 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071777 Apr 12 10:52:57 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 271/796] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:52:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:52:58 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:58 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:58 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-234bd7ed-d2f2-4a4c-a907-7f4bd2e6af93 req-f5167207-5308-40f6-a08e-d0e959fba10d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8", "name": "network-vif-deleted", "tag": "2c64da14-81c7-48d5-b272-2e09127f33fd"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:52:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-234bd7ed-d2f2-4a4c-a907-7f4bd2e6af93 req-f5167207-5308-40f6-a08e-d0e959fba10d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-234bd7ed-d2f2-4a4c-a907-7f4bd2e6af93 req-f5167207-5308-40f6-a08e-d0e959fba10d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-234bd7ed-d2f2-4a4c-a907-7f4bd2e6af93 req-f5167207-5308-40f6-a08e-d0e959fba10d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:58 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-234bd7ed-d2f2-4a4c-a907-7f4bd2e6af93 req-f5167207-5308-40f6-a08e-d0e959fba10d service nova] Creating event network-vif-deleted:2c64da14-81c7-48d5-b272-2e09127f33fd for instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 on user Apr 12 10:52:58 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-234bd7ed-d2f2-4a4c-a907-7f4bd2e6af93 req-f5167207-5308-40f6-a08e-d0e959fba10d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037374 Apr 12 10:52:58 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 266/797] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:52:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:52:58 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d3f0fdc8-afd1-4d38-9e93-683e91569764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:58 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d3f0fdc8-afd1-4d38-9e93-683e91569764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:58 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:52:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d3f0fdc8-afd1-4d38-9e93-683e91569764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d3f0fdc8-afd1-4d38-9e93-683e91569764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d3f0fdc8-afd1-4d38-9e93-683e91569764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d3f0fdc8-afd1-4d38-9e93-683e91569764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d3f0fdc8-afd1-4d38-9e93-683e91569764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d3f0fdc8-afd1-4d38-9e93-683e91569764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:59 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-d3f0fdc8-afd1-4d38-9e93-683e91569764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:52:59 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-d3f0fdc8-afd1-4d38-9e93-683e91569764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc" status: 200 len: 1536 microversion: 2.1 time: 0.203116 Apr 12 10:52:59 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 261/798] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:52:58 2023] GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc => generated 1536 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:52:59 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f995f27e-c4b5-452f-9f15-7303cedd4263 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:59 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-f995f27e-c4b5-452f-9f15-7303cedd4263 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:52:59 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f995f27e-c4b5-452f-9f15-7303cedd4263 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Searching by: {'deleted': False, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408'} {{(pid=61854) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 12 10:52:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f995f27e-c4b5-452f-9f15-7303cedd4263 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f995f27e-c4b5-452f-9f15-7303cedd4263 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f995f27e-c4b5-452f-9f15-7303cedd4263 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f995f27e-c4b5-452f-9f15-7303cedd4263 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f995f27e-c4b5-452f-9f15-7303cedd4263 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f995f27e-c4b5-452f-9f15-7303cedd4263 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:59 user devstack@n-api.service[61854]: DEBUG nova.compute.multi_cell_list [None req-f995f27e-c4b5-452f-9f15-7303cedd4263 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61854) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 10:52:59 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-c36b497a-9296-4255-ab57-7b847e8a588e req-395fa113-de94-4783-a197-7cf873286edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8", "name": "network-vif-plugged", "status": "completed", "tag": "2c64da14-81c7-48d5-b272-2e09127f33fd"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:52:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-c36b497a-9296-4255-ab57-7b847e8a588e req-395fa113-de94-4783-a197-7cf873286edd service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-c36b497a-9296-4255-ab57-7b847e8a588e req-395fa113-de94-4783-a197-7cf873286edd service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-c36b497a-9296-4255-ab57-7b847e8a588e req-395fa113-de94-4783-a197-7cf873286edd service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:59 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-c36b497a-9296-4255-ab57-7b847e8a588e req-395fa113-de94-4783-a197-7cf873286edd service nova] Creating event network-vif-plugged:2c64da14-81c7-48d5-b272-2e09127f33fd for instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 on user Apr 12 10:52:59 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-c36b497a-9296-4255-ab57-7b847e8a588e req-395fa113-de94-4783-a197-7cf873286edd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028389 Apr 12 10:52:59 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 267/799] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:52:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:52:59 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f995f27e-c4b5-452f-9f15-7303cedd4263 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.216573 Apr 12 10:52:59 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 272/800] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 12 10:52:59 2023] GET /compute/v2.1/servers => generated 341 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:52:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-5d226895-bddd-4bbc-9b1a-85a43fe0af15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:59 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-5d226895-bddd-4bbc-9b1a-85a43fe0af15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5d226895-bddd-4bbc-9b1a-85a43fe0af15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5d226895-bddd-4bbc-9b1a-85a43fe0af15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5d226895-bddd-4bbc-9b1a-85a43fe0af15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5d226895-bddd-4bbc-9b1a-85a43fe0af15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5d226895-bddd-4bbc-9b1a-85a43fe0af15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-5d226895-bddd-4bbc-9b1a-85a43fe0af15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:59 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-5d226895-bddd-4bbc-9b1a-85a43fe0af15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:52:59 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-5d226895-bddd-4bbc-9b1a-85a43fe0af15 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc" status: 200 len: 1536 microversion: 2.1 time: 0.151949 Apr 12 10:52:59 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 262/801] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:52:59 2023] GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc => generated 1536 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:52:59 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-65f943bb-8e69-4eda-9fc0-74ad89c5b7ef tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:59 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-65f943bb-8e69-4eda-9fc0-74ad89c5b7ef tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:52:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-65f943bb-8e69-4eda-9fc0-74ad89c5b7ef tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-65f943bb-8e69-4eda-9fc0-74ad89c5b7ef tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-65f943bb-8e69-4eda-9fc0-74ad89c5b7ef tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-65f943bb-8e69-4eda-9fc0-74ad89c5b7ef tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:52:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-65f943bb-8e69-4eda-9fc0-74ad89c5b7ef tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:52:59 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-65f943bb-8e69-4eda-9fc0-74ad89c5b7ef tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:52:59 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-65f943bb-8e69-4eda-9fc0-74ad89c5b7ef tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] HTTP exception thrown: Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 could not be found. Apr 12 10:52:59 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-65f943bb-8e69-4eda-9fc0-74ad89c5b7ef tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Request method failure captured: Apr 12 10:52:59 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7 HTTP/1.1 Apr 12 10:52:59 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:52:59 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:52:59 user devstack@n-api.service[61852]: Connection: close Apr 12 10:52:59 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:52:59 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:52:59 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:52:59 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:52:59 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:52:59 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNosjxmxcVjmUpCMLAxdRdLndUlKxh4MkCcirUvRtNoND63IGb1xoGABQC8D9rLRE4dW_L0z2oNcBU8jtABVmL5XlYtTU15Uvd1NUbrH9hi6BA13fINZDRHpVQlP0DCe8J969vT87xyN1x_qfcLnOr5CvtvwcJHsWkRykm4XG-p9tMms Apr 12 10:52:59 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:52:59 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:52:59 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:52:59 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:52:59 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:52:59 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:52:59 user devstack@n-api.service[61852]: X-Project-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:52:59 user devstack@n-api.service[61852]: X-Project-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:52:59 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:52:59 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:52:59 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:52:59 user devstack@n-api.service[61852]: X-Tenant: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:52:59 user devstack@n-api.service[61852]: X-Tenant-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:52:59 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:52:59 user devstack@n-api.service[61852]: X-User: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:52:59 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:52:59 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:52:59 user devstack@n-api.service[61852]: X-User-Id: 7ec47d3cdacb45e5a39509e76b546e34 Apr 12 10:52:59 user devstack@n-api.service[61852]: X-User-Name: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:52:59 user devstack@n-api.service[61852]: method: > Apr 12 10:52:59 user devstack@n-api.service[61852]: exception: Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 could not be found. Apr 12 10:52:59 user devstack@n-api.service[61852]: action_args: {'id': '82ea43d4-f2b9-4665-b1c9-412367e2b4d7'} Apr 12 10:52:59 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 could not be found. Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 could not be found. Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 could not be found. Apr 12 10:52:59 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:52:59 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-65f943bb-8e69-4eda-9fc0-74ad89c5b7ef tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Returning 404 to user: Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:52:59 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-65f943bb-8e69-4eda-9fc0-74ad89c5b7ef tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7" status: 404 len: 111 microversion: 2.1 time: 0.037446 Apr 12 10:52:59 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 268/802] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:52:59 2023] GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:52:59 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9632ab76-70d9-4165-b125-832fa1487f5a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '.version_select at 0x7fabbf6a7eb0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:52:59 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9632ab76-70d9-4165-b125-832fa1487f5a tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2069030893" status: 202 len: 0 microversion: 2.1 time: 0.032890 Apr 12 10:52:59 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 273/803] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 10:52:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2069030893 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:53:00 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8464c53f-4d42-4c00-957a-6d249a19700f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Action: 'create', calling method: .version_select at 0x7fabbf6cc8b0>, body: {"keypair": {"name": "tempest-keypair-1567303486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+hB5VUXtE8B/YaMiFQ2YUKHLAghyGHpe7cu33U+wTFBemejCfwunXyySeBzqPTLAjvTdvbP0Krte07gGPW8AcjjlLUZvUIYG48wpov2PrAl8Hw38NY5EVmxBCiRNse7Q=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:00 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-8464c53f-4d42-4c00-957a-6d249a19700f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting quotas for project c3cecbfbfd5f42dbb663367f6fbdf3b0. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:53:00 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-8464c53f-4d42-4c00-957a-6d249a19700f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting quotas for user 7ec47d3cdacb45e5a39509e76b546e34 and project c3cecbfbfd5f42dbb663367f6fbdf3b0. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:53:00 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8464c53f-4d42-4c00-957a-6d249a19700f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066483 Apr 12 10:53:00 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 263/804] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 10:53:00 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:01 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab32971b-fad9-41b7-8447-224947e10d53"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:01 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:01 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298549 Apr 12 10:53:01 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 269/805] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:53:01 2023] POST /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:02 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1560426502", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0"}], "security_groups": [{"name": "tempest-securitygroup--722055801"}], "key_name": "tempest-keypair-1567303486", "user_data": "}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:02 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] validate_networks() for [('ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:53:02 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:53:02 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:53:02 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:53:02 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:53:02 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:53:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:02 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting quotas for project c3cecbfbfd5f42dbb663367f6fbdf3b0. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:53:02 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting quotas for user 7ec47d3cdacb45e5a39509e76b546e34 and project c3cecbfbfd5f42dbb663367f6fbdf3b0. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:53:02 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:53:02 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:53:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.599643 Apr 12 10:53:03 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 274/806] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:53:02 2023] POST /compute/v2.1/servers => generated 399 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:53:03 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-24da3fc5-14e7-4de9-aae5-4e7be874efcb tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:53:03 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-24da3fc5-14e7-4de9-aae5-4e7be874efcb tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:03 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-24da3fc5-14e7-4de9-aae5-4e7be874efcb tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec47d3cdacb45e5a39509e76b546e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cecbfbfd5f42dbb663367f6fbdf3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:53:03 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-24da3fc5-14e7-4de9-aae5-4e7be874efcb tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5" status: 200 len: 1236 microversion: 2.1 time: 0.073195 Apr 12 10:53:03 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 264/807] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:53:03 2023] GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5 => generated 1236 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:53:05 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-6f00677d-4dce-4058-8d2c-f2ad9573c33b req-c713e4ea-e1ab-4207-916a-c4a60f395c16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcd57d3d-16cb-4b4e-8785-ae15027621a5", "tag": "4372d146-13c3-4479-84ba-bdf514061696"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-6f00677d-4dce-4058-8d2c-f2ad9573c33b req-c713e4ea-e1ab-4207-916a-c4a60f395c16 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-6f00677d-4dce-4058-8d2c-f2ad9573c33b req-c713e4ea-e1ab-4207-916a-c4a60f395c16 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-6f00677d-4dce-4058-8d2c-f2ad9573c33b req-c713e4ea-e1ab-4207-916a-c4a60f395c16 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:05 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-6f00677d-4dce-4058-8d2c-f2ad9573c33b req-c713e4ea-e1ab-4207-916a-c4a60f395c16 service nova] Creating event network-changed:4372d146-13c3-4479-84ba-bdf514061696 for instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 on user Apr 12 10:53:05 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-6f00677d-4dce-4058-8d2c-f2ad9573c33b req-c713e4ea-e1ab-4207-916a-c4a60f395c16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059694 Apr 12 10:53:05 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 270/808] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-bdc42e64-2e35-4862-83da-7ac1dc10b9b2 req-4a5cb70c-1837-437d-913a-13025e7508e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd57d3d-16cb-4b4e-8785-ae15027621a5", "name": "network-vif-plugged", "status": "completed", "tag": "4372d146-13c3-4479-84ba-bdf514061696"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-bdc42e64-2e35-4862-83da-7ac1dc10b9b2 req-4a5cb70c-1837-437d-913a-13025e7508e0 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-bdc42e64-2e35-4862-83da-7ac1dc10b9b2 req-4a5cb70c-1837-437d-913a-13025e7508e0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-bdc42e64-2e35-4862-83da-7ac1dc10b9b2 req-4a5cb70c-1837-437d-913a-13025e7508e0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-bdc42e64-2e35-4862-83da-7ac1dc10b9b2 req-4a5cb70c-1837-437d-913a-13025e7508e0 service nova] Creating event network-vif-plugged:4372d146-13c3-4479-84ba-bdf514061696 for instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 on user Apr 12 10:53:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-bdc42e64-2e35-4862-83da-7ac1dc10b9b2 req-4a5cb70c-1837-437d-913a-13025e7508e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043696 Apr 12 10:53:08 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 275/809] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:09 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-33357c43-3ae4-4c31-bd64-bec83a6fac4d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:53:09 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-33357c43-3ae4-4c31-bd64-bec83a6fac4d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-33357c43-3ae4-4c31-bd64-bec83a6fac4d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-33357c43-3ae4-4c31-bd64-bec83a6fac4d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-33357c43-3ae4-4c31-bd64-bec83a6fac4d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-33357c43-3ae4-4c31-bd64-bec83a6fac4d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-33357c43-3ae4-4c31-bd64-bec83a6fac4d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-33357c43-3ae4-4c31-bd64-bec83a6fac4d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:09 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-33357c43-3ae4-4c31-bd64-bec83a6fac4d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:53:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-33357c43-3ae4-4c31-bd64-bec83a6fac4d tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc" status: 200 len: 1582 microversion: 2.1 time: 0.170260 Apr 12 10:53:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 265/810] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:53:09 2023] GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc => generated 1582 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:53:10 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-411ff742-6240-485f-ad32-8957783cd151 req-0346ccac-0a64-4d34-bf94-8281f4e3693c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd57d3d-16cb-4b4e-8785-ae15027621a5", "name": "network-vif-plugged", "status": "completed", "tag": "4372d146-13c3-4479-84ba-bdf514061696"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-411ff742-6240-485f-ad32-8957783cd151 req-0346ccac-0a64-4d34-bf94-8281f4e3693c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-411ff742-6240-485f-ad32-8957783cd151 req-0346ccac-0a64-4d34-bf94-8281f4e3693c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-411ff742-6240-485f-ad32-8957783cd151 req-0346ccac-0a64-4d34-bf94-8281f4e3693c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:10 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-411ff742-6240-485f-ad32-8957783cd151 req-0346ccac-0a64-4d34-bf94-8281f4e3693c service nova] Creating event network-vif-plugged:4372d146-13c3-4479-84ba-bdf514061696 for instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 on user Apr 12 10:53:10 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-411ff742-6240-485f-ad32-8957783cd151 req-0346ccac-0a64-4d34-bf94-8281f4e3693c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031864 Apr 12 10:53:10 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 271/811] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:10 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-75cb58b2-d9f1-4c41-b8c7-9418df2dbff9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:53:10 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-75cb58b2-d9f1-4c41-b8c7-9418df2dbff9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-75cb58b2-d9f1-4c41-b8c7-9418df2dbff9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-75cb58b2-d9f1-4c41-b8c7-9418df2dbff9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-75cb58b2-d9f1-4c41-b8c7-9418df2dbff9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-75cb58b2-d9f1-4c41-b8c7-9418df2dbff9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-75cb58b2-d9f1-4c41-b8c7-9418df2dbff9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-75cb58b2-d9f1-4c41-b8c7-9418df2dbff9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-75cb58b2-d9f1-4c41-b8c7-9418df2dbff9 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.096242 Apr 12 10:53:10 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 276/812] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 10:53:10 2023] GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/os-interface => generated 282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:11 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-b8074d23-ce08-4928-897a-df5fc3e11f84 req-5ea802fc-e34b-4a82-b09f-9a5946b5d732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faa11b52-f2b6-45aa-937f-7468095ddb22", "tag": "46213af2-2a93-4502-9f35-eda3d5b9f7fc"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b8074d23-ce08-4928-897a-df5fc3e11f84 req-5ea802fc-e34b-4a82-b09f-9a5946b5d732 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b8074d23-ce08-4928-897a-df5fc3e11f84 req-5ea802fc-e34b-4a82-b09f-9a5946b5d732 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b8074d23-ce08-4928-897a-df5fc3e11f84 req-5ea802fc-e34b-4a82-b09f-9a5946b5d732 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:11 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-b8074d23-ce08-4928-897a-df5fc3e11f84 req-5ea802fc-e34b-4a82-b09f-9a5946b5d732 service nova] Creating event network-changed:46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance faa11b52-f2b6-45aa-937f-7468095ddb22 on user Apr 12 10:53:11 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-b8074d23-ce08-4928-897a-df5fc3e11f84 req-5ea802fc-e34b-4a82-b09f-9a5946b5d732 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045415 Apr 12 10:53:11 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 266/813] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:11 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7d3b210-cbed-4d4a-8f47-f68cd0560193"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:11 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:12 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "POST /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.401295 Apr 12 10:53:12 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 272/814] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:53:11 2023] POST /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/os-volume_attachments => generated 194 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:12 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-21b48b0a-9860-4d86-8402-4a6eb4e140ba req-7673f42c-e067-4a17-890a-c3e3c93f6e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc51c71-9d3b-4957-b912-0666c68b46fc", "tag": "66db319f-02d8-4e75-b71a-2b2d136671a9"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-21b48b0a-9860-4d86-8402-4a6eb4e140ba req-7673f42c-e067-4a17-890a-c3e3c93f6e77 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-21b48b0a-9860-4d86-8402-4a6eb4e140ba req-7673f42c-e067-4a17-890a-c3e3c93f6e77 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-21b48b0a-9860-4d86-8402-4a6eb4e140ba req-7673f42c-e067-4a17-890a-c3e3c93f6e77 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-21b48b0a-9860-4d86-8402-4a6eb4e140ba req-7673f42c-e067-4a17-890a-c3e3c93f6e77 service nova] Creating event network-changed:66db319f-02d8-4e75-b71a-2b2d136671a9 for instance cdc51c71-9d3b-4957-b912-0666c68b46fc on user Apr 12 10:53:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-21b48b0a-9860-4d86-8402-4a6eb4e140ba req-7673f42c-e067-4a17-890a-c3e3c93f6e77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042776 Apr 12 10:53:12 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 277/815] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:12 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-15f9c45d-ad21-42c5-96cc-8d868d53cdb0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-632119673"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:12 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-15f9c45d-ad21-42c5-96cc-8d868d53cdb0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-15f9c45d-ad21-42c5-96cc-8d868d53cdb0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-15f9c45d-ad21-42c5-96cc-8d868d53cdb0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-15f9c45d-ad21-42c5-96cc-8d868d53cdb0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-15f9c45d-ad21-42c5-96cc-8d868d53cdb0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-15f9c45d-ad21-42c5-96cc-8d868d53cdb0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-15f9c45d-ad21-42c5-96cc-8d868d53cdb0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:12 user devstack@n-api.service[61853]: INFO nova.network.security_group_api [None req-15f9c45d-ad21-42c5-96cc-8d868d53cdb0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Adding security group 238ef89f-adfb-4094-8fda-7c23da4c89ba to port 66db319f-02d8-4e75-b71a-2b2d136671a9 Apr 12 10:53:13 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:53:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-15f9c45d-ad21-42c5-96cc-8d868d53cdb0 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc/action" status: 202 len: 0 microversion: 2.1 time: 1.147402 Apr 12 10:53:13 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 267/816] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:53:12 2023] POST /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc/action => generated 0 bytes in 1149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:53:13 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-634d02d4-ef57-4835-a073-74ee69ee4a21 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:53:13 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-634d02d4-ef57-4835-a073-74ee69ee4a21 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-634d02d4-ef57-4835-a073-74ee69ee4a21 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-634d02d4-ef57-4835-a073-74ee69ee4a21 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-634d02d4-ef57-4835-a073-74ee69ee4a21 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-634d02d4-ef57-4835-a073-74ee69ee4a21 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-634d02d4-ef57-4835-a073-74ee69ee4a21 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-634d02d4-ef57-4835-a073-74ee69ee4a21 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:14 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-634d02d4-ef57-4835-a073-74ee69ee4a21 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:53:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-634d02d4-ef57-4835-a073-74ee69ee4a21 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc" status: 200 len: 1747 microversion: 2.1 time: 0.174799 Apr 12 10:53:14 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 273/817] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:53:13 2023] GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc => generated 1747 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:53:14 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:53:14 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:53:14 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:14 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc/action" status: 202 len: 0 microversion: 2.1 time: 0.118842 Apr 12 10:53:14 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 278/818] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:53:14 2023] POST /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:53:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-dca9c796-196b-4ee6-a27e-5fc20f10ed9a tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:53:14 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-dca9c796-196b-4ee6-a27e-5fc20f10ed9a tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-dca9c796-196b-4ee6-a27e-5fc20f10ed9a tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-dca9c796-196b-4ee6-a27e-5fc20f10ed9a tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-dca9c796-196b-4ee6-a27e-5fc20f10ed9a tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-dca9c796-196b-4ee6-a27e-5fc20f10ed9a tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-dca9c796-196b-4ee6-a27e-5fc20f10ed9a tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-dca9c796-196b-4ee6-a27e-5fc20f10ed9a tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:14 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-dca9c796-196b-4ee6-a27e-5fc20f10ed9a tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:53:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-dca9c796-196b-4ee6-a27e-5fc20f10ed9a tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc" status: 200 len: 1739 microversion: 2.1 time: 0.176025 Apr 12 10:53:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 268/819] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:53:14 2023] GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:53:14 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-f9742d66-668e-4f0f-92ac-843a414b61e3 req-73dba2ae-f4f8-4dbf-8acc-1728ac8d6d5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc51c71-9d3b-4957-b912-0666c68b46fc", "tag": "66db319f-02d8-4e75-b71a-2b2d136671a9"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-f9742d66-668e-4f0f-92ac-843a414b61e3 req-73dba2ae-f4f8-4dbf-8acc-1728ac8d6d5b service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-f9742d66-668e-4f0f-92ac-843a414b61e3 req-73dba2ae-f4f8-4dbf-8acc-1728ac8d6d5b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:14 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-f9742d66-668e-4f0f-92ac-843a414b61e3 req-73dba2ae-f4f8-4dbf-8acc-1728ac8d6d5b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-f9742d66-668e-4f0f-92ac-843a414b61e3 req-73dba2ae-f4f8-4dbf-8acc-1728ac8d6d5b service nova] Creating event network-changed:66db319f-02d8-4e75-b71a-2b2d136671a9 for instance cdc51c71-9d3b-4957-b912-0666c68b46fc on user Apr 12 10:53:14 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-f9742d66-668e-4f0f-92ac-843a414b61e3 req-73dba2ae-f4f8-4dbf-8acc-1728ac8d6d5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031729 Apr 12 10:53:14 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 274/820] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:17 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-0fe2bf6f-0afa-4063-b4e8-018aa8040cb2 req-3038853a-781e-4a58-80e5-aacffb753fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc51c71-9d3b-4957-b912-0666c68b46fc", "name": "network-vif-unplugged", "status": "completed", "tag": "66db319f-02d8-4e75-b71a-2b2d136671a9"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:17 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:53:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-0fe2bf6f-0afa-4063-b4e8-018aa8040cb2 req-3038853a-781e-4a58-80e5-aacffb753fd8 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:17 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4db5f3ec-4424-48f1-9d47-d626a68860fe tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:53:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-0fe2bf6f-0afa-4063-b4e8-018aa8040cb2 req-3038853a-781e-4a58-80e5-aacffb753fd8 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-0fe2bf6f-0afa-4063-b4e8-018aa8040cb2 req-3038853a-781e-4a58-80e5-aacffb753fd8 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:17 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-4db5f3ec-4424-48f1-9d47-d626a68860fe tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:17 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:53:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4db5f3ec-4424-48f1-9d47-d626a68860fe tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4db5f3ec-4424-48f1-9d47-d626a68860fe tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4db5f3ec-4424-48f1-9d47-d626a68860fe tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4db5f3ec-4424-48f1-9d47-d626a68860fe tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4db5f3ec-4424-48f1-9d47-d626a68860fe tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:17 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4db5f3ec-4424-48f1-9d47-d626a68860fe tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:17 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-0fe2bf6f-0afa-4063-b4e8-018aa8040cb2 req-3038853a-781e-4a58-80e5-aacffb753fd8 service nova] Creating event network-vif-unplugged:66db319f-02d8-4e75-b71a-2b2d136671a9 for instance cdc51c71-9d3b-4957-b912-0666c68b46fc on user Apr 12 10:53:17 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-0fe2bf6f-0afa-4063-b4e8-018aa8040cb2 req-3038853a-781e-4a58-80e5-aacffb753fd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055058 Apr 12 10:53:17 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 279/821] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:17 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-4db5f3ec-4424-48f1-9d47-d626a68860fe tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] HTTP exception thrown: Instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa could not be found. Apr 12 10:53:17 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4db5f3ec-4424-48f1-9d47-d626a68860fe tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Request method failure captured: Apr 12 10:53:17 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa HTTP/1.1 Apr 12 10:53:17 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:53:17 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:53:17 user devstack@n-api.service[61853]: Connection: close Apr 12 10:53:17 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:53:17 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:53:17 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:53:17 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:53:17 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:53:17 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolqGozV0Qu6SZmLnBoQNVS50cJGXvsoBmeV4kYNwwYJArQIYSrdoUYOhzr6a5xIwwWeKJWDA_aJ_7UXxKKH2gGl3NJVdJUiMFH66pZ8ZO9-s58wWiuTldpVpc8BUrzPWh_ozOVgQS7bUcGiqoIkH32PPxJ3U-ltY7mPcX2o4oUd4oc Apr 12 10:53:17 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:53:17 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:53:17 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:53:17 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:53:17 user devstack@n-api.service[61853]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 10:53:17 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:53:17 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:53:17 user devstack@n-api.service[61853]: X-Project-Id: 3789b59ccc704f86afac83af21fd84f9 Apr 12 10:53:17 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1826285115 Apr 12 10:53:17 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:53:17 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:53:17 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3789b59ccc704f86afac83af21fd84f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3789b59ccc704f86afac83af21fd84f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3789b59ccc704f86afac83af21fd84f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:53:17 user devstack@n-api.service[61853]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1826285115 Apr 12 10:53:17 user devstack@n-api.service[61853]: X-Tenant-Id: 3789b59ccc704f86afac83af21fd84f9 Apr 12 10:53:17 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1826285115 Apr 12 10:53:17 user devstack@n-api.service[61853]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member Apr 12 10:53:17 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:53:17 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:53:17 user devstack@n-api.service[61853]: X-User-Id: ba49b947c74e48f3b161b6f9fce8b1c5 Apr 12 10:53:17 user devstack@n-api.service[61853]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member Apr 12 10:53:17 user devstack@n-api.service[61853]: method: > Apr 12 10:53:17 user devstack@n-api.service[61853]: exception: Instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa could not be found. Apr 12 10:53:17 user devstack@n-api.service[61853]: action_args: {'id': '7ba7c401-554c-4610-b8a3-8cf7e62f8cfa'} Apr 12 10:53:17 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa could not be found. Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa could not be found. Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa could not be found. Apr 12 10:53:17 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:53:17 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4db5f3ec-4424-48f1-9d47-d626a68860fe tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Returning 404 to user: Instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:53:17 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-4db5f3ec-4424-48f1-9d47-d626a68860fe tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" status: 404 len: 111 microversion: 2.87 time: 0.043121 Apr 12 10:53:17 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 269/822] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:53:17 2023] GET /compute/v2.1/servers/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:53:17 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:53:17 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:17 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:53:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:17 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:17 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:53:17 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:53:17 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" status: 204 len: 0 microversion: 2.87 time: 0.133276 Apr 12 10:53:17 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 275/823] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 10:53:17 2023] DELETE /compute/v2.1/servers/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 10:53:17 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-07ab3b19-4e7f-478e-aff5-3fedeb118e14 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:53:17 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-07ab3b19-4e7f-478e-aff5-3fedeb118e14 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-07ab3b19-4e7f-478e-aff5-3fedeb118e14 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-07ab3b19-4e7f-478e-aff5-3fedeb118e14 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-07ab3b19-4e7f-478e-aff5-3fedeb118e14 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-07ab3b19-4e7f-478e-aff5-3fedeb118e14 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-07ab3b19-4e7f-478e-aff5-3fedeb118e14 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:17 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-07ab3b19-4e7f-478e-aff5-3fedeb118e14 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:18 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-07ab3b19-4e7f-478e-aff5-3fedeb118e14 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:53:18 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-07ab3b19-4e7f-478e-aff5-3fedeb118e14 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:53:18 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-07ab3b19-4e7f-478e-aff5-3fedeb118e14 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:53:18 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-07ab3b19-4e7f-478e-aff5-3fedeb118e14 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" status: 200 len: 1696 microversion: 2.87 time: 0.216538 Apr 12 10:53:18 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 280/824] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:53:17 2023] GET /compute/v2.1/servers/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 => generated 1696 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:53:19 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc51c71-9d3b-4957-b912-0666c68b46fc", "name": "network-vif-plugged", "status": "completed", "tag": "66db319f-02d8-4e75-b71a-2b2d136671a9"}, {"server_uuid": "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6", "name": "network-vif-unplugged", "status": "completed", "tag": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0"}, {"server_uuid": "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6", "name": "network-vif-plugged", "status": "completed", "tag": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:19 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:53:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:19 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=41 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:53:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] Creating event network-vif-plugged:66db319f-02d8-4e75-b71a-2b2d136671a9 for instance cdc51c71-9d3b-4957-b912-0666c68b46fc on user Apr 12 10:53:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] Creating event network-vif-unplugged:ce57bd29-c20b-4373-8e1c-724a3cf51fb0 for instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 on user Apr 12 10:53:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] Creating event network-vif-plugged:ce57bd29-c20b-4373-8e1c-724a3cf51fb0 for instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 on user Apr 12 10:53:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.050667 Apr 12 10:53:19 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 270/825] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:19 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:19 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-655caba7-4cd9-45a6-aede-964f3d4fe420 req-8df6a52e-acc3-42ac-90be-bd97ef2a8dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6", "name": "network-vif-deleted", "tag": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-655caba7-4cd9-45a6-aede-964f3d4fe420 req-8df6a52e-acc3-42ac-90be-bd97ef2a8dc7 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-655caba7-4cd9-45a6-aede-964f3d4fe420 req-8df6a52e-acc3-42ac-90be-bd97ef2a8dc7 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-655caba7-4cd9-45a6-aede-964f3d4fe420 req-8df6a52e-acc3-42ac-90be-bd97ef2a8dc7 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:19 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-655caba7-4cd9-45a6-aede-964f3d4fe420 req-8df6a52e-acc3-42ac-90be-bd97ef2a8dc7 service nova] Creating event network-vif-deleted:ce57bd29-c20b-4373-8e1c-724a3cf51fb0 for instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 on user Apr 12 10:53:19 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-655caba7-4cd9-45a6-aede-964f3d4fe420 req-8df6a52e-acc3-42ac-90be-bd97ef2a8dc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036154 Apr 12 10:53:19 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 276/826] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:20 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:20 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:20 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'flavor' on Instance uuid faa11b52-f2b6-45aa-937f-7468095ddb22 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:53:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "POST /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/action" status: 200 len: 32 microversion: 2.1 time: 0.233257 Apr 12 10:53:20 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 281/827] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:53:20 2023] POST /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/action => generated 32 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 12 10:53:20 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1360b170-256e-4c84-9872-afce5244b191 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:53:20 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-1360b170-256e-4c84-9872-afce5244b191 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1360b170-256e-4c84-9872-afce5244b191 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1360b170-256e-4c84-9872-afce5244b191 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1360b170-256e-4c84-9872-afce5244b191 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1360b170-256e-4c84-9872-afce5244b191 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1360b170-256e-4c84-9872-afce5244b191 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1360b170-256e-4c84-9872-afce5244b191 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:20 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-1360b170-256e-4c84-9872-afce5244b191 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:53:20 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1360b170-256e-4c84-9872-afce5244b191 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22" status: 200 len: 1725 microversion: 2.1 time: 0.196138 Apr 12 10:53:20 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 271/828] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:53:20 2023] GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:53:21 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-62d87f2a-9d13-431b-9f17-b8957c92b345 req-20082376-17ce-4080-9d67-24b0297ff798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa11b52-f2b6-45aa-937f-7468095ddb22", "name": "network-vif-unplugged", "status": "completed", "tag": "46213af2-2a93-4502-9f35-eda3d5b9f7fc"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-62d87f2a-9d13-431b-9f17-b8957c92b345 req-20082376-17ce-4080-9d67-24b0297ff798 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-62d87f2a-9d13-431b-9f17-b8957c92b345 req-20082376-17ce-4080-9d67-24b0297ff798 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-62d87f2a-9d13-431b-9f17-b8957c92b345 req-20082376-17ce-4080-9d67-24b0297ff798 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:21 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-62d87f2a-9d13-431b-9f17-b8957c92b345 req-20082376-17ce-4080-9d67-24b0297ff798 service nova] Creating event network-vif-unplugged:46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance faa11b52-f2b6-45aa-937f-7468095ddb22 on user Apr 12 10:53:21 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-62d87f2a-9d13-431b-9f17-b8957c92b345 req-20082376-17ce-4080-9d67-24b0297ff798 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029917 Apr 12 10:53:21 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 277/829] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:21 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc51c71-9d3b-4957-b912-0666c68b46fc", "name": "network-vif-plugged", "status": "completed", "tag": "66db319f-02d8-4e75-b71a-2b2d136671a9"}, {"server_uuid": "cdc51c71-9d3b-4957-b912-0666c68b46fc", "name": "network-vif-plugged", "status": "completed", "tag": "66db319f-02d8-4e75-b71a-2b2d136671a9"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] Creating event network-vif-plugged:66db319f-02d8-4e75-b71a-2b2d136671a9 for instance cdc51c71-9d3b-4957-b912-0666c68b46fc on user Apr 12 10:53:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] Creating event network-vif-plugged:66db319f-02d8-4e75-b71a-2b2d136671a9 for instance cdc51c71-9d3b-4957-b912-0666c68b46fc on user Apr 12 10:53:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050167 Apr 12 10:53:21 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 282/830] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:23 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-592bf819-7103-44fb-b559-7875a6d72b64 req-90a85c7f-b439-4045-b947-97d33d725c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa11b52-f2b6-45aa-937f-7468095ddb22", "name": "network-vif-plugged", "status": "completed", "tag": "46213af2-2a93-4502-9f35-eda3d5b9f7fc"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-592bf819-7103-44fb-b559-7875a6d72b64 req-90a85c7f-b439-4045-b947-97d33d725c97 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-592bf819-7103-44fb-b559-7875a6d72b64 req-90a85c7f-b439-4045-b947-97d33d725c97 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-592bf819-7103-44fb-b559-7875a6d72b64 req-90a85c7f-b439-4045-b947-97d33d725c97 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-592bf819-7103-44fb-b559-7875a6d72b64 req-90a85c7f-b439-4045-b947-97d33d725c97 service nova] Creating event network-vif-plugged:46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance faa11b52-f2b6-45aa-937f-7468095ddb22 on user Apr 12 10:53:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-592bf819-7103-44fb-b559-7875a6d72b64 req-90a85c7f-b439-4045-b947-97d33d725c97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043971 Apr 12 10:53:23 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 272/831] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:25 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa11b52-f2b6-45aa-937f-7468095ddb22", "name": "network-vif-plugged", "status": "completed", "tag": "46213af2-2a93-4502-9f35-eda3d5b9f7fc"}, {"server_uuid": "faa11b52-f2b6-45aa-937f-7468095ddb22", "name": "network-vif-plugged", "status": "completed", "tag": "46213af2-2a93-4502-9f35-eda3d5b9f7fc"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] Creating event network-vif-plugged:46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance faa11b52-f2b6-45aa-937f-7468095ddb22 on user Apr 12 10:53:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] Creating event network-vif-plugged:46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance faa11b52-f2b6-45aa-937f-7468095ddb22 on user Apr 12 10:53:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042811 Apr 12 10:53:25 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 278/832] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:36 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=9 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:53:36 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:53:36 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-af5888bc-afb4-4042-824c-2e806fdf5d65 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:53:36 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-af5888bc-afb4-4042-824c-2e806fdf5d65 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-af5888bc-afb4-4042-824c-2e806fdf5d65 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-af5888bc-afb4-4042-824c-2e806fdf5d65 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-af5888bc-afb4-4042-824c-2e806fdf5d65 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-af5888bc-afb4-4042-824c-2e806fdf5d65 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-af5888bc-afb4-4042-824c-2e806fdf5d65 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-af5888bc-afb4-4042-824c-2e806fdf5d65 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-af5888bc-afb4-4042-824c-2e806fdf5d65 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.104881 Apr 12 10:53:36 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 283/833] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 10:53:36 2023] GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136/os-interface => generated 283 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:37 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=5 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:53:37 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=9 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:53:37 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-3d0454ab-55db-4db9-83c4-c9cfdbdcefed req-685ce64b-a236-4ea5-8f43-192aeea73bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23", "tag": "59e0f8a4-966b-46f3-921d-be0c6f15f281"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3d0454ab-55db-4db9-83c4-c9cfdbdcefed req-685ce64b-a236-4ea5-8f43-192aeea73bf2 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3d0454ab-55db-4db9-83c4-c9cfdbdcefed req-685ce64b-a236-4ea5-8f43-192aeea73bf2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3d0454ab-55db-4db9-83c4-c9cfdbdcefed req-685ce64b-a236-4ea5-8f43-192aeea73bf2 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:37 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:53:37 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:53:37 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-8ba9dfb2-57f6-4dd8-8489-5b6e352cdb40 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:53:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-3d0454ab-55db-4db9-83c4-c9cfdbdcefed req-685ce64b-a236-4ea5-8f43-192aeea73bf2 service nova] Creating event network-changed:59e0f8a4-966b-46f3-921d-be0c6f15f281 for instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 on user Apr 12 10:53:37 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-8ba9dfb2-57f6-4dd8-8489-5b6e352cdb40 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-3d0454ab-55db-4db9-83c4-c9cfdbdcefed req-685ce64b-a236-4ea5-8f43-192aeea73bf2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041187 Apr 12 10:53:37 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 273/834] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:37 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8ba9dfb2-57f6-4dd8-8489-5b6e352cdb40 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:37 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8ba9dfb2-57f6-4dd8-8489-5b6e352cdb40 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:37 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8ba9dfb2-57f6-4dd8-8489-5b6e352cdb40 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:37 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8ba9dfb2-57f6-4dd8-8489-5b6e352cdb40 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:37 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8ba9dfb2-57f6-4dd8-8489-5b6e352cdb40 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:37 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8ba9dfb2-57f6-4dd8-8489-5b6e352cdb40 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:37 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-71f6d8cb-3c72-43ab-8b8b-df63a3422270 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:53:37 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-71f6d8cb-3c72-43ab-8b8b-df63a3422270 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-71f6d8cb-3c72-43ab-8b8b-df63a3422270 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-71f6d8cb-3c72-43ab-8b8b-df63a3422270 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-71f6d8cb-3c72-43ab-8b8b-df63a3422270 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-71f6d8cb-3c72-43ab-8b8b-df63a3422270 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-71f6d8cb-3c72-43ab-8b8b-df63a3422270 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-71f6d8cb-3c72-43ab-8b8b-df63a3422270 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:37 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-71f6d8cb-3c72-43ab-8b8b-df63a3422270 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6576467073e41e9b497097d5a8dfd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9878bfe34ceb4a6695b253ad161c4f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:53:37 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-71f6d8cb-3c72-43ab-8b8b-df63a3422270 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644" status: 200 len: 1537 microversion: 2.1 time: 0.155844 Apr 12 10:53:37 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 284/835] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:53:37 2023] GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644 => generated 1537 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:53:37 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-8ba9dfb2-57f6-4dd8-8489-5b6e352cdb40 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:53:37 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-8ba9dfb2-57f6-4dd8-8489-5b6e352cdb40 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136" status: 200 len: 1428 microversion: 2.1 time: 0.318848 Apr 12 10:53:37 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 279/836] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:53:37 2023] GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136 => generated 1428 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:53:37 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:37 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:38 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:53:38 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Old instance type m1.nano, new instance type m1.micro {{(pid=61853) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 12 10:53:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:38 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting quotas for project 32235c67d269474b879a58269c1bfb28. Resources: {'cores', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:53:38 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting quotas for user 0059d31539304ffcb5214b408751cd4f and project 32235c67d269474b879a58269c1bfb28. Resources: {'cores', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:53:38 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:53:38 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:53:38 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:53:38 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:53:38 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:53:38 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136/action" status: 202 len: 0 microversion: 2.1 time: 0.651640 Apr 12 10:53:38 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 274/837] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:53:37 2023] POST /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:53:38 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-bf8e51fa-e080-447a-8192-556b317d3d26 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:53:38 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-bf8e51fa-e080-447a-8192-556b317d3d26 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bf8e51fa-e080-447a-8192-556b317d3d26 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bf8e51fa-e080-447a-8192-556b317d3d26 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bf8e51fa-e080-447a-8192-556b317d3d26 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bf8e51fa-e080-447a-8192-556b317d3d26 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bf8e51fa-e080-447a-8192-556b317d3d26 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:38 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bf8e51fa-e080-447a-8192-556b317d3d26 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:38 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-bf8e51fa-e080-447a-8192-556b317d3d26 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:53:38 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-bf8e51fa-e080-447a-8192-556b317d3d26 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136" status: 200 len: 1437 microversion: 2.1 time: 0.170868 Apr 12 10:53:38 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 285/838] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:53:38 2023] GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136 => generated 1437 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:53:39 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-70bb2fbf-7024-422e-a036-2768ec1b005f req-1221b0f6-430e-49f4-9d38-2d414b149910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cb22a78-94df-49fb-918c-32856e1b5136", "tag": "225efc65-26fe-4d54-93aa-35298d6ddd3f"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-70bb2fbf-7024-422e-a036-2768ec1b005f req-1221b0f6-430e-49f4-9d38-2d414b149910 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-70bb2fbf-7024-422e-a036-2768ec1b005f req-1221b0f6-430e-49f4-9d38-2d414b149910 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-70bb2fbf-7024-422e-a036-2768ec1b005f req-1221b0f6-430e-49f4-9d38-2d414b149910 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:39 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-70bb2fbf-7024-422e-a036-2768ec1b005f req-1221b0f6-430e-49f4-9d38-2d414b149910 service nova] Creating event network-changed:225efc65-26fe-4d54-93aa-35298d6ddd3f for instance 0cb22a78-94df-49fb-918c-32856e1b5136 on user Apr 12 10:53:39 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-70bb2fbf-7024-422e-a036-2768ec1b005f req-1221b0f6-430e-49f4-9d38-2d414b149910 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031108 Apr 12 10:53:39 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 280/839] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:41 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb22a78-94df-49fb-918c-32856e1b5136", "name": "network-vif-unplugged", "status": "completed", "tag": "225efc65-26fe-4d54-93aa-35298d6ddd3f"}, {"server_uuid": "0cb22a78-94df-49fb-918c-32856e1b5136", "name": "network-vif-plugged", "status": "completed", "tag": "225efc65-26fe-4d54-93aa-35298d6ddd3f"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] Creating event network-vif-unplugged:225efc65-26fe-4d54-93aa-35298d6ddd3f for instance 0cb22a78-94df-49fb-918c-32856e1b5136 on user Apr 12 10:53:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] Creating event network-vif-plugged:225efc65-26fe-4d54-93aa-35298d6ddd3f for instance 0cb22a78-94df-49fb-918c-32856e1b5136 on user Apr 12 10:53:41 user devstack@n-api.service[61853]: DEBUG nova.compute.api [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] Instance 0cb22a78-94df-49fb-918c-32856e1b5136 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61853) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 10:53:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.081460 Apr 12 10:53:41 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 275/840] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:41 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:47 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-4cffd05b-7591-4e8f-8d7a-edc50968d818 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:53:47 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-4cffd05b-7591-4e8f-8d7a-edc50968d818 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4cffd05b-7591-4e8f-8d7a-edc50968d818 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4cffd05b-7591-4e8f-8d7a-edc50968d818 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4cffd05b-7591-4e8f-8d7a-edc50968d818 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4cffd05b-7591-4e8f-8d7a-edc50968d818 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4cffd05b-7591-4e8f-8d7a-edc50968d818 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4cffd05b-7591-4e8f-8d7a-edc50968d818 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:47 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-4cffd05b-7591-4e8f-8d7a-edc50968d818 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HTTP exception thrown: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. Apr 12 10:53:47 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-4cffd05b-7591-4e8f-8d7a-edc50968d818 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Request method failure captured: Apr 12 10:53:47 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 HTTP/1.1 Apr 12 10:53:47 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:53:47 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:53:47 user devstack@n-api.service[61854]: Connection: close Apr 12 10:53:47 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:53:47 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:53:47 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:53:47 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:53:47 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:53:47 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNovxs2Yantu_ODChXuBI9nxlNd7q64TcAdmUtsdyhrTlt2TPQv6HrTQUW80fTGqaBlerbQwCAm7dWKzvWOOjt7pPApBNdqpqIJVLzbKcuxIuQw915erA4Eg80ETTsBe76KDhlSBBUJHZF_I_Yg-BxJFHiVfAbJBMyp551Ap5yqYIsVQ Apr 12 10:53:47 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:53:47 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:53:47 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:53:47 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:53:47 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:53:47 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:53:47 user devstack@n-api.service[61854]: X-Project-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:53:47 user devstack@n-api.service[61854]: X-Project-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:53:47 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:53:47 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:53:47 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:53:47 user devstack@n-api.service[61854]: X-Tenant: tempest-TestVolumeBootPattern-638607559 Apr 12 10:53:47 user devstack@n-api.service[61854]: X-Tenant-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:53:47 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:53:47 user devstack@n-api.service[61854]: X-User: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:53:47 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:53:47 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:53:47 user devstack@n-api.service[61854]: X-User-Id: b914d7ca786f455baf120f98816abffd Apr 12 10:53:47 user devstack@n-api.service[61854]: X-User-Name: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:53:47 user devstack@n-api.service[61854]: method: > Apr 12 10:53:47 user devstack@n-api.service[61854]: exception: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. Apr 12 10:53:47 user devstack@n-api.service[61854]: action_args: {'id': '468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8'} Apr 12 10:53:47 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. Apr 12 10:53:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:53:47 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-4cffd05b-7591-4e8f-8d7a-edc50968d818 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Returning 404 to user: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:53:47 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-4cffd05b-7591-4e8f-8d7a-edc50968d818 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" status: 404 len: 111 microversion: 2.1 time: 0.035443 Apr 12 10:53:47 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 286/841] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:53:47 2023] GET /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:53:49 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:53:49 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:49 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:49 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:49 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:49 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:49 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:49 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:49 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:53:49 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd" status: 204 len: 0 microversion: 2.1 time: 0.107126 Apr 12 10:53:49 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 281/842] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:53:49 2023] DELETE /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:53:49 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:53:49 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-98c01afa-70fa-4dbf-ad3f-b596719039d8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:53:49 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-98c01afa-70fa-4dbf-ad3f-b596719039d8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-98c01afa-70fa-4dbf-ad3f-b596719039d8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-98c01afa-70fa-4dbf-ad3f-b596719039d8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-98c01afa-70fa-4dbf-ad3f-b596719039d8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-98c01afa-70fa-4dbf-ad3f-b596719039d8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-98c01afa-70fa-4dbf-ad3f-b596719039d8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-98c01afa-70fa-4dbf-ad3f-b596719039d8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:49 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-98c01afa-70fa-4dbf-ad3f-b596719039d8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:53:49 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-98c01afa-70fa-4dbf-ad3f-b596719039d8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd" status: 200 len: 1397 microversion: 2.1 time: 0.213003 Apr 12 10:53:49 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 276/843] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:53:49 2023] GET /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd => generated 1397 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:53:49 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-cf293c97-d138-4247-a848-27dc39ed307a req-5053f23b-c00d-4e16-8208-a9a09870752d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b99fe06-9139-4475-aa72-2968a59df0bd", "name": "network-vif-unplugged", "status": "completed", "tag": "d728429a-36b4-4d31-abe3-ef0cd1154866"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cf293c97-d138-4247-a848-27dc39ed307a req-5053f23b-c00d-4e16-8208-a9a09870752d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cf293c97-d138-4247-a848-27dc39ed307a req-5053f23b-c00d-4e16-8208-a9a09870752d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cf293c97-d138-4247-a848-27dc39ed307a req-5053f23b-c00d-4e16-8208-a9a09870752d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:49 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-cf293c97-d138-4247-a848-27dc39ed307a req-5053f23b-c00d-4e16-8208-a9a09870752d service nova] Creating event network-vif-unplugged:d728429a-36b4-4d31-abe3-ef0cd1154866 for instance 6b99fe06-9139-4475-aa72-2968a59df0bd on user Apr 12 10:53:49 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-cf293c97-d138-4247-a848-27dc39ed307a req-5053f23b-c00d-4e16-8208-a9a09870752d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028856 Apr 12 10:53:49 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 287/844] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:51 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-1cd66f07-c2b9-4179-8627-90a02ac906e9 req-16af134f-7051-4cbd-a322-b69945dbc436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb22a78-94df-49fb-918c-32856e1b5136", "name": "network-vif-plugged", "status": "completed", "tag": "225efc65-26fe-4d54-93aa-35298d6ddd3f"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:51 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-1cd66f07-c2b9-4179-8627-90a02ac906e9 req-16af134f-7051-4cbd-a322-b69945dbc436 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:51 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-1cd66f07-c2b9-4179-8627-90a02ac906e9 req-16af134f-7051-4cbd-a322-b69945dbc436 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:51 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-1cd66f07-c2b9-4179-8627-90a02ac906e9 req-16af134f-7051-4cbd-a322-b69945dbc436 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:51 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-1cd66f07-c2b9-4179-8627-90a02ac906e9 req-16af134f-7051-4cbd-a322-b69945dbc436 service nova] Creating event network-vif-plugged:225efc65-26fe-4d54-93aa-35298d6ddd3f for instance 0cb22a78-94df-49fb-918c-32856e1b5136 on user Apr 12 10:53:51 user devstack@n-api.service[61852]: DEBUG nova.compute.api [req-1cd66f07-c2b9-4179-8627-90a02ac906e9 req-16af134f-7051-4cbd-a322-b69945dbc436 service nova] Instance 0cb22a78-94df-49fb-918c-32856e1b5136 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61852) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 10:53:51 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-1cd66f07-c2b9-4179-8627-90a02ac906e9 req-16af134f-7051-4cbd-a322-b69945dbc436 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042398 Apr 12 10:53:51 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 282/845] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-1a19c2d4-a8a7-464c-bbb5-f910c1bb1bb7 req-0d6309b5-60f7-4e83-bc14-aaef24453f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b99fe06-9139-4475-aa72-2968a59df0bd", "name": "network-vif-plugged", "status": "completed", "tag": "d728429a-36b4-4d31-abe3-ef0cd1154866"}, {"server_uuid": "6b99fe06-9139-4475-aa72-2968a59df0bd", "name": "network-vif-deleted", "tag": "d728429a-36b4-4d31-abe3-ef0cd1154866"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1a19c2d4-a8a7-464c-bbb5-f910c1bb1bb7 req-0d6309b5-60f7-4e83-bc14-aaef24453f3d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1a19c2d4-a8a7-464c-bbb5-f910c1bb1bb7 req-0d6309b5-60f7-4e83-bc14-aaef24453f3d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1a19c2d4-a8a7-464c-bbb5-f910c1bb1bb7 req-0d6309b5-60f7-4e83-bc14-aaef24453f3d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-1a19c2d4-a8a7-464c-bbb5-f910c1bb1bb7 req-0d6309b5-60f7-4e83-bc14-aaef24453f3d service nova] Creating event network-vif-plugged:d728429a-36b4-4d31-abe3-ef0cd1154866 for instance 6b99fe06-9139-4475-aa72-2968a59df0bd on user Apr 12 10:53:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-1a19c2d4-a8a7-464c-bbb5-f910c1bb1bb7 req-0d6309b5-60f7-4e83-bc14-aaef24453f3d service nova] Creating event network-vif-deleted:d728429a-36b4-4d31-abe3-ef0cd1154866 for instance 6b99fe06-9139-4475-aa72-2968a59df0bd on user Apr 12 10:53:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-1a19c2d4-a8a7-464c-bbb5-f910c1bb1bb7 req-0d6309b5-60f7-4e83-bc14-aaef24453f3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033605 Apr 12 10:53:52 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 277/846] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:52 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:53:53 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-32030470-6144-497c-9be0-6403329c5e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:53:53 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-32030470-6144-497c-9be0-6403329c5e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:53:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-32030470-6144-497c-9be0-6403329c5e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-32030470-6144-497c-9be0-6403329c5e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-32030470-6144-497c-9be0-6403329c5e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-32030470-6144-497c-9be0-6403329c5e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-32030470-6144-497c-9be0-6403329c5e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-32030470-6144-497c-9be0-6403329c5e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:53 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-32030470-6144-497c-9be0-6403329c5e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec47d3cdacb45e5a39509e76b546e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cecbfbfd5f42dbb663367f6fbdf3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:53:53 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-32030470-6144-497c-9be0-6403329c5e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5" status: 200 len: 1545 microversion: 2.1 time: 0.232852 Apr 12 10:53:53 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 288/847] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:53:53 2023] GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5 => generated 1545 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:53:53 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-6a7db1f7-4a6b-4925-acb1-af9e487918b5 req-e7b1dcba-6c5d-4875-ba4d-fec99fccfe80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb22a78-94df-49fb-918c-32856e1b5136", "name": "network-vif-plugged", "status": "completed", "tag": "225efc65-26fe-4d54-93aa-35298d6ddd3f"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:53:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-6a7db1f7-4a6b-4925-acb1-af9e487918b5 req-e7b1dcba-6c5d-4875-ba4d-fec99fccfe80 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:53:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-6a7db1f7-4a6b-4925-acb1-af9e487918b5 req-e7b1dcba-6c5d-4875-ba4d-fec99fccfe80 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:53:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-6a7db1f7-4a6b-4925-acb1-af9e487918b5 req-e7b1dcba-6c5d-4875-ba4d-fec99fccfe80 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:53:53 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-6a7db1f7-4a6b-4925-acb1-af9e487918b5 req-e7b1dcba-6c5d-4875-ba4d-fec99fccfe80 service nova] Creating event network-vif-plugged:225efc65-26fe-4d54-93aa-35298d6ddd3f for instance 0cb22a78-94df-49fb-918c-32856e1b5136 on user Apr 12 10:53:53 user devstack@n-api.service[61852]: DEBUG nova.compute.api [req-6a7db1f7-4a6b-4925-acb1-af9e487918b5 req-e7b1dcba-6c5d-4875-ba4d-fec99fccfe80 service nova] Instance 0cb22a78-94df-49fb-918c-32856e1b5136 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61852) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 10:53:53 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-6a7db1f7-4a6b-4925-acb1-af9e487918b5 req-e7b1dcba-6c5d-4875-ba4d-fec99fccfe80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055129 Apr 12 10:53:53 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 283/848] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:53:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:54:04 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=22 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:54:04 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:54:04 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-c2941c29-a4af-42f4-9a37-72a745124562 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:04 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-c2941c29-a4af-42f4-9a37-72a745124562 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c2941c29-a4af-42f4-9a37-72a745124562 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c2941c29-a4af-42f4-9a37-72a745124562 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c2941c29-a4af-42f4-9a37-72a745124562 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c2941c29-a4af-42f4-9a37-72a745124562 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c2941c29-a4af-42f4-9a37-72a745124562 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-c2941c29-a4af-42f4-9a37-72a745124562 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:04 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-c2941c29-a4af-42f4-9a37-72a745124562 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:54:04 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-c2941c29-a4af-42f4-9a37-72a745124562 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc" status: 200 len: 1747 microversion: 2.1 time: 0.183504 Apr 12 10:54:04 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 278/849] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:54:04 2023] GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc => generated 1747 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:54:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d19abd2a-7b05-4e6a-a92f-4ec82a1ce304 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:08 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d19abd2a-7b05-4e6a-a92f-4ec82a1ce304 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:08 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=12 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:54:08 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=26 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:54:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d19abd2a-7b05-4e6a-a92f-4ec82a1ce304 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d19abd2a-7b05-4e6a-a92f-4ec82a1ce304 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d19abd2a-7b05-4e6a-a92f-4ec82a1ce304 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d19abd2a-7b05-4e6a-a92f-4ec82a1ce304 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d19abd2a-7b05-4e6a-a92f-4ec82a1ce304 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d19abd2a-7b05-4e6a-a92f-4ec82a1ce304 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-d19abd2a-7b05-4e6a-a92f-4ec82a1ce304 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] HTTP exception thrown: Instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 could not be found. Apr 12 10:54:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d19abd2a-7b05-4e6a-a92f-4ec82a1ce304 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Request method failure captured: Apr 12 10:54:08 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 HTTP/1.1 Apr 12 10:54:08 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:54:08 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:54:08 user devstack@n-api.service[61854]: Connection: close Apr 12 10:54:08 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:54:08 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:54:08 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:54:08 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:54:08 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:54:08 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNolqGozV0Qu6SZmLnBoQNVS50cJGXvsoBmeV4kYNwwYJArQIYSrdoUYOhzr6a5xIwwWeKJWDA_aJ_7UXxKKH2gGl3NJVdJUiMFH66pZ8ZO9-s58wWiuTldpVpc8BUrzPWh_ozOVgQS7bUcGiqoIkH32PPxJ3U-ltY7mPcX2o4oUd4oc Apr 12 10:54:08 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:54:08 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:54:08 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:54:08 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:54:08 user devstack@n-api.service[61854]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 10:54:08 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:54:08 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:54:08 user devstack@n-api.service[61854]: X-Project-Id: 3789b59ccc704f86afac83af21fd84f9 Apr 12 10:54:08 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1826285115 Apr 12 10:54:08 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:54:08 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:54:08 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3789b59ccc704f86afac83af21fd84f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3789b59ccc704f86afac83af21fd84f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3789b59ccc704f86afac83af21fd84f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:54:08 user devstack@n-api.service[61854]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1826285115 Apr 12 10:54:08 user devstack@n-api.service[61854]: X-Tenant-Id: 3789b59ccc704f86afac83af21fd84f9 Apr 12 10:54:08 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1826285115 Apr 12 10:54:08 user devstack@n-api.service[61854]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member Apr 12 10:54:08 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:54:08 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:54:08 user devstack@n-api.service[61854]: X-User-Id: ba49b947c74e48f3b161b6f9fce8b1c5 Apr 12 10:54:08 user devstack@n-api.service[61854]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member Apr 12 10:54:08 user devstack@n-api.service[61854]: method: > Apr 12 10:54:08 user devstack@n-api.service[61854]: exception: Instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 could not be found. Apr 12 10:54:08 user devstack@n-api.service[61854]: action_args: {'id': 'dda9c8d0-6b6e-468f-a129-0675aa2cc2d6'} Apr 12 10:54:08 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 could not be found. Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 could not be found. Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 could not be found. Apr 12 10:54:08 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:54:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d19abd2a-7b05-4e6a-a92f-4ec82a1ce304 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Returning 404 to user: Instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:54:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d19abd2a-7b05-4e6a-a92f-4ec82a1ce304 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" status: 404 len: 111 microversion: 2.87 time: 0.033016 Apr 12 10:54:08 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 289/850] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:54:08 2023] GET /compute/v2.1/servers/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:54:08 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:54:08 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:54:08 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:08 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:08 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:54:08 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" status: 204 len: 0 microversion: 2.87 time: 0.110944 Apr 12 10:54:08 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 284/851] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 10:54:08 2023] DELETE /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 10:54:08 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-08515896-b12e-42df-abc6-9f1b5d334c81 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:08 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-08515896-b12e-42df-abc6-9f1b5d334c81 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-08515896-b12e-42df-abc6-9f1b5d334c81 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-08515896-b12e-42df-abc6-9f1b5d334c81 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-08515896-b12e-42df-abc6-9f1b5d334c81 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-08515896-b12e-42df-abc6-9f1b5d334c81 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-08515896-b12e-42df-abc6-9f1b5d334c81 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-08515896-b12e-42df-abc6-9f1b5d334c81 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:08 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-08515896-b12e-42df-abc6-9f1b5d334c81 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:54:08 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-08515896-b12e-42df-abc6-9f1b5d334c81 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:54:08 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-08515896-b12e-42df-abc6-9f1b5d334c81 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:54:08 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-08515896-b12e-42df-abc6-9f1b5d334c81 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" status: 200 len: 1773 microversion: 2.87 time: 0.185232 Apr 12 10:54:08 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 279/852] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:54:08 2023] GET /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 => generated 1773 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:54:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-92ddfa15-6c9f-4b61-bcd0-d99ce3745486 req-6c843458-1266-4937-94e5-b26a9bddb158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212", "name": "network-vif-unplugged", "status": "completed", "tag": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:54:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-92ddfa15-6c9f-4b61-bcd0-d99ce3745486 req-6c843458-1266-4937-94e5-b26a9bddb158 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-92ddfa15-6c9f-4b61-bcd0-d99ce3745486 req-6c843458-1266-4937-94e5-b26a9bddb158 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-92ddfa15-6c9f-4b61-bcd0-d99ce3745486 req-6c843458-1266-4937-94e5-b26a9bddb158 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-92ddfa15-6c9f-4b61-bcd0-d99ce3745486 req-6c843458-1266-4937-94e5-b26a9bddb158 service nova] Creating event network-vif-unplugged:1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 on user Apr 12 10:54:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-92ddfa15-6c9f-4b61-bcd0-d99ce3745486 req-6c843458-1266-4937-94e5-b26a9bddb158 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030573 Apr 12 10:54:08 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 290/853] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:54:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:54:09 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-a091070f-87c7-4255-8703-7ff4dc917d8c req-f57b4f87-651b-481c-be3e-3e7de75432b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212", "name": "network-vif-deleted", "tag": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:54:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-a091070f-87c7-4255-8703-7ff4dc917d8c req-f57b4f87-651b-481c-be3e-3e7de75432b0 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-a091070f-87c7-4255-8703-7ff4dc917d8c req-f57b4f87-651b-481c-be3e-3e7de75432b0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:09 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-a091070f-87c7-4255-8703-7ff4dc917d8c req-f57b4f87-651b-481c-be3e-3e7de75432b0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:09 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-a091070f-87c7-4255-8703-7ff4dc917d8c req-f57b4f87-651b-481c-be3e-3e7de75432b0 service nova] Creating event network-vif-deleted:1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 on user Apr 12 10:54:09 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-a091070f-87c7-4255-8703-7ff4dc917d8c req-f57b4f87-651b-481c-be3e-3e7de75432b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034941 Apr 12 10:54:09 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 285/854] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:54:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:54:10 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-f2f61d95-4458-43fe-850e-56e061e7755d req-e0752e97-3688-43e9-8580-91f4a3a2c81e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212", "name": "network-vif-plugged", "status": "completed", "tag": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:54:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f2f61d95-4458-43fe-850e-56e061e7755d req-e0752e97-3688-43e9-8580-91f4a3a2c81e service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f2f61d95-4458-43fe-850e-56e061e7755d req-e0752e97-3688-43e9-8580-91f4a3a2c81e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-f2f61d95-4458-43fe-850e-56e061e7755d req-e0752e97-3688-43e9-8580-91f4a3a2c81e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:10 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-f2f61d95-4458-43fe-850e-56e061e7755d req-e0752e97-3688-43e9-8580-91f4a3a2c81e service nova] Creating event network-vif-plugged:1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 on user Apr 12 10:54:10 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-f2f61d95-4458-43fe-850e-56e061e7755d req-e0752e97-3688-43e9-8580-91f4a3a2c81e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031505 Apr 12 10:54:10 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 280/855] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:54:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:54:10 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-cb818c80-32ef-481a-99bd-a220f7d2819f tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:10 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-cb818c80-32ef-481a-99bd-a220f7d2819f tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cb818c80-32ef-481a-99bd-a220f7d2819f tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cb818c80-32ef-481a-99bd-a220f7d2819f tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cb818c80-32ef-481a-99bd-a220f7d2819f tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cb818c80-32ef-481a-99bd-a220f7d2819f tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cb818c80-32ef-481a-99bd-a220f7d2819f tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-cb818c80-32ef-481a-99bd-a220f7d2819f tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:11 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-cb818c80-32ef-481a-99bd-a220f7d2819f tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:54:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-cb818c80-32ef-481a-99bd-a220f7d2819f tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22" status: 200 len: 1705 microversion: 2.1 time: 0.277829 Apr 12 10:54:11 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 291/856] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:54:10 2023] GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22 => generated 1705 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:54:28 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-d5ce1c6b-c067-4ffd-89ea-dd16889be639 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:28 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-d5ce1c6b-c067-4ffd-89ea-dd16889be639 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:28 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:54:28 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:54:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d5ce1c6b-c067-4ffd-89ea-dd16889be639 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d5ce1c6b-c067-4ffd-89ea-dd16889be639 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d5ce1c6b-c067-4ffd-89ea-dd16889be639 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d5ce1c6b-c067-4ffd-89ea-dd16889be639 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d5ce1c6b-c067-4ffd-89ea-dd16889be639 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d5ce1c6b-c067-4ffd-89ea-dd16889be639 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:29 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-d5ce1c6b-c067-4ffd-89ea-dd16889be639 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:54:29 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-d5ce1c6b-c067-4ffd-89ea-dd16889be639 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136" status: 200 len: 1555 microversion: 2.1 time: 0.161822 Apr 12 10:54:29 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 286/857] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:54:28 2023] GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:54:38 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=8 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:54:38 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=14 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:54:38 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3bff1f77-3af0-41b0-9065-f700dd4f4774 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:38 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-3bff1f77-3af0-41b0-9065-f700dd4f4774 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3bff1f77-3af0-41b0-9065-f700dd4f4774 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3bff1f77-3af0-41b0-9065-f700dd4f4774 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3bff1f77-3af0-41b0-9065-f700dd4f4774 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3bff1f77-3af0-41b0-9065-f700dd4f4774 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3bff1f77-3af0-41b0-9065-f700dd4f4774 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:38 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3bff1f77-3af0-41b0-9065-f700dd4f4774 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:38 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-3bff1f77-3af0-41b0-9065-f700dd4f4774 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.101844 Apr 12 10:54:38 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 281/858] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 10:54:38 2023] GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644/os-interface => generated 282 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:54:39 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-adaff219-1138-4b49-a7aa-a737d0496f18 req-4dc2b9c9-87cb-4f98-9e61-71c3a78ae5ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aef35e7-5daf-4d41-b91b-a7ff4a481644", "tag": "8786a087-f036-403b-9b82-c75fc6dbb110"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:54:39 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:54:39 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=10 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:54:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-adaff219-1138-4b49-a7aa-a737d0496f18 req-4dc2b9c9-87cb-4f98-9e61-71c3a78ae5ec service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-adaff219-1138-4b49-a7aa-a737d0496f18 req-4dc2b9c9-87cb-4f98-9e61-71c3a78ae5ec service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-adaff219-1138-4b49-a7aa-a737d0496f18 req-4dc2b9c9-87cb-4f98-9e61-71c3a78ae5ec service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-adaff219-1138-4b49-a7aa-a737d0496f18 req-4dc2b9c9-87cb-4f98-9e61-71c3a78ae5ec service nova] Creating event network-changed:8786a087-f036-403b-9b82-c75fc6dbb110 for instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 on user Apr 12 10:54:39 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-adaff219-1138-4b49-a7aa-a737d0496f18 req-4dc2b9c9-87cb-4f98-9e61-71c3a78ae5ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034687 Apr 12 10:54:39 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 292/859] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:54:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:54:39 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-eb9e4b71-bde9-40f1-ac85-ae72f688b771 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:39 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-eb9e4b71-bde9-40f1-ac85-ae72f688b771 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:39 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:54:39 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:54:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-eb9e4b71-bde9-40f1-ac85-ae72f688b771 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-eb9e4b71-bde9-40f1-ac85-ae72f688b771 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-eb9e4b71-bde9-40f1-ac85-ae72f688b771 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-eb9e4b71-bde9-40f1-ac85-ae72f688b771 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-eb9e4b71-bde9-40f1-ac85-ae72f688b771 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-eb9e4b71-bde9-40f1-ac85-ae72f688b771 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:39 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-eb9e4b71-bde9-40f1-ac85-ae72f688b771 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644/ips" status: 200 len: 104 microversion: 2.1 time: 0.036875 Apr 12 10:54:39 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 287/860] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 10:54:39 2023] GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644/ips => generated 104 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:54:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-cba84ce9-114e-4ca8-82bc-96fba7740b2b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:39 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-cba84ce9-114e-4ca8-82bc-96fba7740b2b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cba84ce9-114e-4ca8-82bc-96fba7740b2b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cba84ce9-114e-4ca8-82bc-96fba7740b2b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cba84ce9-114e-4ca8-82bc-96fba7740b2b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cba84ce9-114e-4ca8-82bc-96fba7740b2b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cba84ce9-114e-4ca8-82bc-96fba7740b2b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cba84ce9-114e-4ca8-82bc-96fba7740b2b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-cba84ce9-114e-4ca8-82bc-96fba7740b2b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HTTP exception thrown: Instance 6b99fe06-9139-4475-aa72-2968a59df0bd could not be found. Apr 12 10:54:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-cba84ce9-114e-4ca8-82bc-96fba7740b2b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Request method failure captured: Apr 12 10:54:39 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd HTTP/1.1 Apr 12 10:54:39 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:54:39 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:54:39 user devstack@n-api.service[61853]: Connection: close Apr 12 10:54:39 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:54:39 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:54:39 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:54:39 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:54:39 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:54:39 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNovxs2Yantu_ODChXuBI9nxlNd7q64TcAdmUtsdyhrTlt2TPQv6HrTQUW80fTGqaBlerbQwCAm7dWKzvWOOjt7pPApBNdqpqIJVLzbKcuxIuQw915erA4Eg80ETTsBe76KDhlSBBUJHZF_I_Yg-BxJFHiVfAbJBMyp551Ap5yqYIsVQ Apr 12 10:54:39 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:54:39 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:54:39 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:54:39 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:54:39 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:54:39 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:54:39 user devstack@n-api.service[61853]: X-Project-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:54:39 user devstack@n-api.service[61853]: X-Project-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:54:39 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:54:39 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:54:39 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:54:39 user devstack@n-api.service[61853]: X-Tenant: tempest-TestVolumeBootPattern-638607559 Apr 12 10:54:39 user devstack@n-api.service[61853]: X-Tenant-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:54:39 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:54:39 user devstack@n-api.service[61853]: X-User: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:54:39 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:54:39 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:54:39 user devstack@n-api.service[61853]: X-User-Id: b914d7ca786f455baf120f98816abffd Apr 12 10:54:39 user devstack@n-api.service[61853]: X-User-Name: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:54:39 user devstack@n-api.service[61853]: method: > Apr 12 10:54:39 user devstack@n-api.service[61853]: exception: Instance 6b99fe06-9139-4475-aa72-2968a59df0bd could not be found. Apr 12 10:54:39 user devstack@n-api.service[61853]: action_args: {'id': '6b99fe06-9139-4475-aa72-2968a59df0bd'} Apr 12 10:54:39 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b99fe06-9139-4475-aa72-2968a59df0bd could not be found. Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b99fe06-9139-4475-aa72-2968a59df0bd could not be found. Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b99fe06-9139-4475-aa72-2968a59df0bd could not be found. Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-cba84ce9-114e-4ca8-82bc-96fba7740b2b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Returning 404 to user: Instance 6b99fe06-9139-4475-aa72-2968a59df0bd could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:54:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-cba84ce9-114e-4ca8-82bc-96fba7740b2b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd" status: 404 len: 111 microversion: 2.1 time: 0.030272 Apr 12 10:54:40 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 282/861] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:54:39 2023] GET /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f69b20af-018d-4878-ae79-5d237ef83009 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f69b20af-018d-4878-ae79-5d237ef83009 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f69b20af-018d-4878-ae79-5d237ef83009 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f69b20af-018d-4878-ae79-5d237ef83009 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f69b20af-018d-4878-ae79-5d237ef83009 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f69b20af-018d-4878-ae79-5d237ef83009 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f69b20af-018d-4878-ae79-5d237ef83009 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f69b20af-018d-4878-ae79-5d237ef83009 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-f69b20af-018d-4878-ae79-5d237ef83009 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HTTP exception thrown: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f69b20af-018d-4878-ae79-5d237ef83009 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Request method failure captured: Apr 12 10:54:40 user devstack@n-api.service[61854]: request: DELETE /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 HTTP/1.1 Apr 12 10:54:40 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:54:40 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:54:40 user devstack@n-api.service[61854]: Connection: close Apr 12 10:54:40 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:54:40 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:54:40 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:54:40 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:54:40 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNovxs2Yantu_ODChXuBI9nxlNd7q64TcAdmUtsdyhrTlt2TPQv6HrTQUW80fTGqaBlerbQwCAm7dWKzvWOOjt7pPApBNdqpqIJVLzbKcuxIuQw915erA4Eg80ETTsBe76KDhlSBBUJHZF_I_Yg-BxJFHiVfAbJBMyp551Ap5yqYIsVQ Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Project-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Project-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Tenant: tempest-TestVolumeBootPattern-638607559 Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Tenant-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:54:40 user devstack@n-api.service[61854]: X-User: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:54:40 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:54:40 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:54:40 user devstack@n-api.service[61854]: X-User-Id: b914d7ca786f455baf120f98816abffd Apr 12 10:54:40 user devstack@n-api.service[61854]: X-User-Name: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:54:40 user devstack@n-api.service[61854]: method: > Apr 12 10:54:40 user devstack@n-api.service[61854]: exception: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. Apr 12 10:54:40 user devstack@n-api.service[61854]: action_args: {'id': '468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8'} Apr 12 10:54:40 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f69b20af-018d-4878-ae79-5d237ef83009 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Returning 404 to user: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:54:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f69b20af-018d-4878-ae79-5d237ef83009 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" status: 404 len: 111 microversion: 2.1 time: 0.032942 Apr 12 10:54:40 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 293/862] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:54:40 2023] DELETE /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:54:40 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-f5195cbb-f719-4f63-9c0a-db44c00b076e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:40 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-f5195cbb-f719-4f63-9c0a-db44c00b076e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:40 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5195cbb-f719-4f63-9c0a-db44c00b076e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:40 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5195cbb-f719-4f63-9c0a-db44c00b076e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:40 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5195cbb-f719-4f63-9c0a-db44c00b076e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:40 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5195cbb-f719-4f63-9c0a-db44c00b076e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:40 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5195cbb-f719-4f63-9c0a-db44c00b076e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:40 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5195cbb-f719-4f63-9c0a-db44c00b076e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:40 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-f5195cbb-f719-4f63-9c0a-db44c00b076e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HTTP exception thrown: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. Apr 12 10:54:40 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-f5195cbb-f719-4f63-9c0a-db44c00b076e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Request method failure captured: Apr 12 10:54:40 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 HTTP/1.1 Apr 12 10:54:40 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:54:40 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:54:40 user devstack@n-api.service[61852]: Connection: close Apr 12 10:54:40 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:54:40 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:54:40 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:54:40 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:54:40 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:54:40 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNovxs2Yantu_ODChXuBI9nxlNd7q64TcAdmUtsdyhrTlt2TPQv6HrTQUW80fTGqaBlerbQwCAm7dWKzvWOOjt7pPApBNdqpqIJVLzbKcuxIuQw915erA4Eg80ETTsBe76KDhlSBBUJHZF_I_Yg-BxJFHiVfAbJBMyp551Ap5yqYIsVQ Apr 12 10:54:40 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:54:40 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:54:40 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:54:40 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:54:40 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:54:40 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:54:40 user devstack@n-api.service[61852]: X-Project-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:54:40 user devstack@n-api.service[61852]: X-Project-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:54:40 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:54:40 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:54:40 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:54:40 user devstack@n-api.service[61852]: X-Tenant: tempest-TestVolumeBootPattern-638607559 Apr 12 10:54:40 user devstack@n-api.service[61852]: X-Tenant-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:54:40 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:54:40 user devstack@n-api.service[61852]: X-User: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:54:40 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:54:40 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:54:40 user devstack@n-api.service[61852]: X-User-Id: b914d7ca786f455baf120f98816abffd Apr 12 10:54:40 user devstack@n-api.service[61852]: X-User-Name: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:54:40 user devstack@n-api.service[61852]: method: > Apr 12 10:54:40 user devstack@n-api.service[61852]: exception: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. Apr 12 10:54:40 user devstack@n-api.service[61852]: action_args: {'id': '468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8'} Apr 12 10:54:40 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. Apr 12 10:54:40 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-f5195cbb-f719-4f63-9c0a-db44c00b076e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Returning 404 to user: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:54:40 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-f5195cbb-f719-4f63-9c0a-db44c00b076e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" status: 404 len: 111 microversion: 2.1 time: 0.026963 Apr 12 10:54:40 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 288/863] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:54:40 2023] GET /compute/v2.1/servers/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0876050f-7ad8-4195-a246-4c980fbea90f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-0876050f-7ad8-4195-a246-4c980fbea90f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0876050f-7ad8-4195-a246-4c980fbea90f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0876050f-7ad8-4195-a246-4c980fbea90f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0876050f-7ad8-4195-a246-4c980fbea90f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0876050f-7ad8-4195-a246-4c980fbea90f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0876050f-7ad8-4195-a246-4c980fbea90f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0876050f-7ad8-4195-a246-4c980fbea90f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-0876050f-7ad8-4195-a246-4c980fbea90f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HTTP exception thrown: Instance 6b99fe06-9139-4475-aa72-2968a59df0bd could not be found. Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0876050f-7ad8-4195-a246-4c980fbea90f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Request method failure captured: Apr 12 10:54:40 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd HTTP/1.1 Apr 12 10:54:40 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:54:40 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:54:40 user devstack@n-api.service[61853]: Connection: close Apr 12 10:54:40 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:54:40 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:54:40 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:54:40 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:54:40 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:54:40 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNovxs2Yantu_ODChXuBI9nxlNd7q64TcAdmUtsdyhrTlt2TPQv6HrTQUW80fTGqaBlerbQwCAm7dWKzvWOOjt7pPApBNdqpqIJVLzbKcuxIuQw915erA4Eg80ETTsBe76KDhlSBBUJHZF_I_Yg-BxJFHiVfAbJBMyp551Ap5yqYIsVQ Apr 12 10:54:40 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:54:40 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:54:40 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:54:40 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:54:40 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:54:40 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:54:40 user devstack@n-api.service[61853]: X-Project-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:54:40 user devstack@n-api.service[61853]: X-Project-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:54:40 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:54:40 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:54:40 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:54:40 user devstack@n-api.service[61853]: X-Tenant: tempest-TestVolumeBootPattern-638607559 Apr 12 10:54:40 user devstack@n-api.service[61853]: X-Tenant-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:54:40 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:54:40 user devstack@n-api.service[61853]: X-User: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:54:40 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:54:40 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:54:40 user devstack@n-api.service[61853]: X-User-Id: b914d7ca786f455baf120f98816abffd Apr 12 10:54:40 user devstack@n-api.service[61853]: X-User-Name: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:54:40 user devstack@n-api.service[61853]: method: > Apr 12 10:54:40 user devstack@n-api.service[61853]: exception: Instance 6b99fe06-9139-4475-aa72-2968a59df0bd could not be found. Apr 12 10:54:40 user devstack@n-api.service[61853]: action_args: {'id': '6b99fe06-9139-4475-aa72-2968a59df0bd'} Apr 12 10:54:40 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b99fe06-9139-4475-aa72-2968a59df0bd could not be found. Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b99fe06-9139-4475-aa72-2968a59df0bd could not be found. Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b99fe06-9139-4475-aa72-2968a59df0bd could not be found. Apr 12 10:54:40 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0876050f-7ad8-4195-a246-4c980fbea90f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Returning 404 to user: Instance 6b99fe06-9139-4475-aa72-2968a59df0bd could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:54:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-0876050f-7ad8-4195-a246-4c980fbea90f tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd" status: 404 len: 111 microversion: 2.1 time: 0.029074 Apr 12 10:54:40 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 283/864] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:54:40 2023] DELETE /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9b7f86cd-bc6f-4f1a-b1a8-464220479f69 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9b7f86cd-bc6f-4f1a-b1a8-464220479f69 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9b7f86cd-bc6f-4f1a-b1a8-464220479f69 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9b7f86cd-bc6f-4f1a-b1a8-464220479f69 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9b7f86cd-bc6f-4f1a-b1a8-464220479f69 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9b7f86cd-bc6f-4f1a-b1a8-464220479f69 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9b7f86cd-bc6f-4f1a-b1a8-464220479f69 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9b7f86cd-bc6f-4f1a-b1a8-464220479f69 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-9b7f86cd-bc6f-4f1a-b1a8-464220479f69 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HTTP exception thrown: Instance 6b99fe06-9139-4475-aa72-2968a59df0bd could not be found. Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9b7f86cd-bc6f-4f1a-b1a8-464220479f69 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Request method failure captured: Apr 12 10:54:40 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd HTTP/1.1 Apr 12 10:54:40 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:54:40 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:54:40 user devstack@n-api.service[61854]: Connection: close Apr 12 10:54:40 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:54:40 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:54:40 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:54:40 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:54:40 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNovxs2Yantu_ODChXuBI9nxlNd7q64TcAdmUtsdyhrTlt2TPQv6HrTQUW80fTGqaBlerbQwCAm7dWKzvWOOjt7pPApBNdqpqIJVLzbKcuxIuQw915erA4Eg80ETTsBe76KDhlSBBUJHZF_I_Yg-BxJFHiVfAbJBMyp551Ap5yqYIsVQ Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Project-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Project-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Tenant: tempest-TestVolumeBootPattern-638607559 Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Tenant-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:54:40 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:54:40 user devstack@n-api.service[61854]: X-User: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:54:40 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:54:40 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:54:40 user devstack@n-api.service[61854]: X-User-Id: b914d7ca786f455baf120f98816abffd Apr 12 10:54:40 user devstack@n-api.service[61854]: X-User-Name: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:54:40 user devstack@n-api.service[61854]: method: > Apr 12 10:54:40 user devstack@n-api.service[61854]: exception: Instance 6b99fe06-9139-4475-aa72-2968a59df0bd could not be found. Apr 12 10:54:40 user devstack@n-api.service[61854]: action_args: {'id': '6b99fe06-9139-4475-aa72-2968a59df0bd'} Apr 12 10:54:40 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b99fe06-9139-4475-aa72-2968a59df0bd could not be found. Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b99fe06-9139-4475-aa72-2968a59df0bd could not be found. Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b99fe06-9139-4475-aa72-2968a59df0bd could not be found. Apr 12 10:54:40 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:54:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9b7f86cd-bc6f-4f1a-b1a8-464220479f69 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Returning 404 to user: Instance 6b99fe06-9139-4475-aa72-2968a59df0bd could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:54:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9b7f86cd-bc6f-4f1a-b1a8-464220479f69 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd" status: 404 len: 111 microversion: 2.1 time: 0.034152 Apr 12 10:54:40 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 294/865] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:54:40 2023] GET /compute/v2.1/servers/6b99fe06-9139-4475-aa72-2968a59df0bd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:54:40 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-43238b76-0371-4271-bcc5-6c011c901c15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Action: 'create', calling method: .version_select at 0x7fabbf55e290>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-162796269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeNYUbBfSwdaJdVL2RMsgRRuPmOdMNSAwl/DHzaeVhE0fDjZe84+pAYZqsgenmNqm/u0yGuL1KeKxxwsT2FNR2LdwQFC7iIcZOaTovpAXdmD/5wx/0lhCQf7gPsmZ5xfg=="}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:54:40 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-43238b76-0371-4271-bcc5-6c011c901c15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting quotas for project a67f3d23b8f74a9496d445c7fc75717e. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:54:40 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-43238b76-0371-4271-bcc5-6c011c901c15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting quotas for user b914d7ca786f455baf120f98816abffd and project a67f3d23b8f74a9496d445c7fc75717e. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:54:40 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-43238b76-0371-4271-bcc5-6c011c901c15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.046880 Apr 12 10:54:40 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 289/866] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 10:54:40 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "811e93eb-e600-41b9-ad7c-577a0f9938d1"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294657 Apr 12 10:54:40 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 284/867] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:54:40 2023] POST /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:54:47 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1015870463", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-162796269", "security_groups": [{"name": "tempest-secgroup-smoke-188917005"}], "block_device_mapping_v2": [{"uuid": "27a37b7e-8277-4e8d-8d37-9fbc82af9ff9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3ecf6069-4851-431c-a1c3-13e94566fa0b"}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:54:47 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] validate_networks() for [('3ecf6069-4851-431c-a1c3-13e94566fa0b', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:54:48 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:54:48 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:54:48 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:54:48 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:54:48 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:54:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:48 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:48 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting quotas for project a67f3d23b8f74a9496d445c7fc75717e. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:54:48 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting quotas for user b914d7ca786f455baf120f98816abffd and project a67f3d23b8f74a9496d445c7fc75717e. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:54:48 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:54:48 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='27a37b7e-8277-4e8d-8d37-9fbc82af9ff9',volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:54:48 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.906823 Apr 12 10:54:48 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 295/868] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:54:47 2023] POST /compute/v2.1/servers => generated 403 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:54:48 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-8cabb4e8-0e4f-4026-b1bc-abc8b74ca1b9 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:48 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-8cabb4e8-0e4f-4026-b1bc-abc8b74ca1b9 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:48 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-8cabb4e8-0e4f-4026-b1bc-abc8b74ca1b9 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:54:48 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-8cabb4e8-0e4f-4026-b1bc-abc8b74ca1b9 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de" status: 200 len: 1089 microversion: 2.1 time: 0.062538 Apr 12 10:54:48 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 290/869] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:54:48 2023] GET /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de => generated 1089 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:54:49 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-126f501e-9325-4b67-b033-868317a57a6c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:54:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-126f501e-9325-4b67-b033-868317a57a6c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-126f501e-9325-4b67-b033-868317a57a6c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-126f501e-9325-4b67-b033-868317a57a6c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:49 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-126f501e-9325-4b67-b033-868317a57a6c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Going to try to stop instance {{(pid=61853) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 12 10:54:49 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-126f501e-9325-4b67-b033-868317a57a6c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644/action" status: 202 len: 0 microversion: 2.1 time: 0.115296 Apr 12 10:54:49 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 285/870] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:54:49 2023] POST /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:54:49 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-83a5657c-9b48-47ae-9ee3-831b8e9d8ba8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:49 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-83a5657c-9b48-47ae-9ee3-831b8e9d8ba8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-83a5657c-9b48-47ae-9ee3-831b8e9d8ba8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-83a5657c-9b48-47ae-9ee3-831b8e9d8ba8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-83a5657c-9b48-47ae-9ee3-831b8e9d8ba8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-83a5657c-9b48-47ae-9ee3-831b8e9d8ba8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-83a5657c-9b48-47ae-9ee3-831b8e9d8ba8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-83a5657c-9b48-47ae-9ee3-831b8e9d8ba8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:49 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-83a5657c-9b48-47ae-9ee3-831b8e9d8ba8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6576467073e41e9b497097d5a8dfd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9878bfe34ceb4a6695b253ad161c4f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:54:49 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-83a5657c-9b48-47ae-9ee3-831b8e9d8ba8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644" status: 200 len: 1712 microversion: 2.1 time: 0.167883 Apr 12 10:54:49 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 296/871] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:54:49 2023] GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644 => generated 1712 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:54:50 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-c582f1d5-c7ed-443d-82bb-c91bea78ce7e req-e6168397-208b-40fb-9de0-c9898f2cfbd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aef35e7-5daf-4d41-b91b-a7ff4a481644", "name": "network-vif-unplugged", "status": "completed", "tag": "8786a087-f036-403b-9b82-c75fc6dbb110"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:54:50 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:54:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-c582f1d5-c7ed-443d-82bb-c91bea78ce7e req-e6168397-208b-40fb-9de0-c9898f2cfbd6 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-c582f1d5-c7ed-443d-82bb-c91bea78ce7e req-e6168397-208b-40fb-9de0-c9898f2cfbd6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-c582f1d5-c7ed-443d-82bb-c91bea78ce7e req-e6168397-208b-40fb-9de0-c9898f2cfbd6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:50 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-c582f1d5-c7ed-443d-82bb-c91bea78ce7e req-e6168397-208b-40fb-9de0-c9898f2cfbd6 service nova] Creating event network-vif-unplugged:8786a087-f036-403b-9b82-c75fc6dbb110 for instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 on user Apr 12 10:54:50 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-c582f1d5-c7ed-443d-82bb-c91bea78ce7e req-e6168397-208b-40fb-9de0-c9898f2cfbd6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032609 Apr 12 10:54:50 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 291/872] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:54:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:54:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aef35e7-5daf-4d41-b91b-a7ff4a481644", "name": "network-vif-plugged", "status": "completed", "tag": "8786a087-f036-403b-9b82-c75fc6dbb110"}, {"name": "network-changed", "server_uuid": "95469ca9-8f8d-4755-8a00-4e2f5689f3de", "tag": "f3314b2f-1470-40cb-9699-71a5020d2bff"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:54:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] Creating event network-vif-plugged:8786a087-f036-403b-9b82-c75fc6dbb110 for instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 on user Apr 12 10:54:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] Creating event network-changed:f3314b2f-1470-40cb-9699-71a5020d2bff for instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de on user Apr 12 10:54:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.036470 Apr 12 10:54:52 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 286/873] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:54:52 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:54:53 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-22ce9bc8-a897-456b-adb1-82eb55f015ab tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:53 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-22ce9bc8-a897-456b-adb1-82eb55f015ab tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-22ce9bc8-a897-456b-adb1-82eb55f015ab tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-22ce9bc8-a897-456b-adb1-82eb55f015ab tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-22ce9bc8-a897-456b-adb1-82eb55f015ab tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-22ce9bc8-a897-456b-adb1-82eb55f015ab tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-22ce9bc8-a897-456b-adb1-82eb55f015ab tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-22ce9bc8-a897-456b-adb1-82eb55f015ab tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:53 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-22ce9bc8-a897-456b-adb1-82eb55f015ab tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.103732 Apr 12 10:54:53 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 297/874] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 10:54:53 2023] GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5/os-interface => generated 283 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:54:54 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-a2a32a60-6795-402a-aabe-900f44c3851c req-d2cdc72f-862a-4bb6-a705-6ee3d08d9157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcd57d3d-16cb-4b4e-8785-ae15027621a5", "tag": "4372d146-13c3-4479-84ba-bdf514061696"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:54:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-a2a32a60-6795-402a-aabe-900f44c3851c req-d2cdc72f-862a-4bb6-a705-6ee3d08d9157 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-a2a32a60-6795-402a-aabe-900f44c3851c req-d2cdc72f-862a-4bb6-a705-6ee3d08d9157 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-a2a32a60-6795-402a-aabe-900f44c3851c req-d2cdc72f-862a-4bb6-a705-6ee3d08d9157 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:54 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-a2a32a60-6795-402a-aabe-900f44c3851c req-d2cdc72f-862a-4bb6-a705-6ee3d08d9157 service nova] Creating event network-changed:4372d146-13c3-4479-84ba-bdf514061696 for instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 on user Apr 12 10:54:54 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-a2a32a60-6795-402a-aabe-900f44c3851c req-d2cdc72f-862a-4bb6-a705-6ee3d08d9157 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028264 Apr 12 10:54:54 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 292/875] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:54:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:54:54 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3b00c1c0-3cb9-424c-8641-fc9dcaf5ca72 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:54 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-3b00c1c0-3cb9-424c-8641-fc9dcaf5ca72 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3b00c1c0-3cb9-424c-8641-fc9dcaf5ca72 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3b00c1c0-3cb9-424c-8641-fc9dcaf5ca72 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3b00c1c0-3cb9-424c-8641-fc9dcaf5ca72 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3b00c1c0-3cb9-424c-8641-fc9dcaf5ca72 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3b00c1c0-3cb9-424c-8641-fc9dcaf5ca72 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3b00c1c0-3cb9-424c-8641-fc9dcaf5ca72 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:54 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-3b00c1c0-3cb9-424c-8641-fc9dcaf5ca72 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5/ips" status: 200 len: 108 microversion: 2.1 time: 0.064856 Apr 12 10:54:54 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 287/876] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 10:54:54 2023] GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5/ips => generated 108 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:54:55 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b178c67e-b2d3-4f88-a2f0-c78db142c223"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:54:55 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:56 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266312 Apr 12 10:54:56 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 298/877] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:54:55 2023] POST /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:54:57 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-95eced3c-c675-41f9-9da0-b37611f00171 req-78558f63-765c-410d-938e-eaa3877340b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95469ca9-8f8d-4755-8a00-4e2f5689f3de", "name": "network-vif-plugged", "status": "completed", "tag": "f3314b2f-1470-40cb-9699-71a5020d2bff"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:54:57 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-95eced3c-c675-41f9-9da0-b37611f00171 req-78558f63-765c-410d-938e-eaa3877340b4 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:57 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-95eced3c-c675-41f9-9da0-b37611f00171 req-78558f63-765c-410d-938e-eaa3877340b4 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:57 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-95eced3c-c675-41f9-9da0-b37611f00171 req-78558f63-765c-410d-938e-eaa3877340b4 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:57 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-95eced3c-c675-41f9-9da0-b37611f00171 req-78558f63-765c-410d-938e-eaa3877340b4 service nova] Creating event network-vif-plugged:f3314b2f-1470-40cb-9699-71a5020d2bff for instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de on user Apr 12 10:54:57 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-95eced3c-c675-41f9-9da0-b37611f00171 req-78558f63-765c-410d-938e-eaa3877340b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047279 Apr 12 10:54:57 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 293/878] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:54:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:54:58 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8b430f61-d75c-4577-9409-86eb27292917 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:58 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-8b430f61-d75c-4577-9409-86eb27292917 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8b430f61-d75c-4577-9409-86eb27292917 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8b430f61-d75c-4577-9409-86eb27292917 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8b430f61-d75c-4577-9409-86eb27292917 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8b430f61-d75c-4577-9409-86eb27292917 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8b430f61-d75c-4577-9409-86eb27292917 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:58 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8b430f61-d75c-4577-9409-86eb27292917 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:58 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-8b430f61-d75c-4577-9409-86eb27292917 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] HTTP exception thrown: Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 could not be found. Apr 12 10:54:58 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8b430f61-d75c-4577-9409-86eb27292917 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Request method failure captured: Apr 12 10:54:58 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 HTTP/1.1 Apr 12 10:54:58 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:54:58 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:54:58 user devstack@n-api.service[61853]: Connection: close Apr 12 10:54:58 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:54:58 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:54:58 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:54:58 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:54:58 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:54:58 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolqGozV0Qu6SZmLnBoQNVS50cJGXvsoBmeV4kYNwwYJArQIYSrdoUYOhzr6a5xIwwWeKJWDA_aJ_7UXxKKH2gGl3NJVdJUiMFH66pZ8ZO9-s58wWiuTldpVpc8BUrzPWh_ozOVgQS7bUcGiqoIkH32PPxJ3U-ltY7mPcX2o4oUd4oc Apr 12 10:54:58 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:54:58 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:54:58 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:54:58 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:54:58 user devstack@n-api.service[61853]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 10:54:58 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:54:58 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:54:58 user devstack@n-api.service[61853]: X-Project-Id: 3789b59ccc704f86afac83af21fd84f9 Apr 12 10:54:58 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1826285115 Apr 12 10:54:58 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:54:58 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:54:58 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3789b59ccc704f86afac83af21fd84f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3789b59ccc704f86afac83af21fd84f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3789b59ccc704f86afac83af21fd84f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:54:58 user devstack@n-api.service[61853]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1826285115 Apr 12 10:54:58 user devstack@n-api.service[61853]: X-Tenant-Id: 3789b59ccc704f86afac83af21fd84f9 Apr 12 10:54:58 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1826285115 Apr 12 10:54:58 user devstack@n-api.service[61853]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member Apr 12 10:54:58 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:54:58 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:54:58 user devstack@n-api.service[61853]: X-User-Id: ba49b947c74e48f3b161b6f9fce8b1c5 Apr 12 10:54:58 user devstack@n-api.service[61853]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member Apr 12 10:54:58 user devstack@n-api.service[61853]: method: > Apr 12 10:54:58 user devstack@n-api.service[61853]: exception: Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 could not be found. Apr 12 10:54:58 user devstack@n-api.service[61853]: action_args: {'id': '8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212'} Apr 12 10:54:58 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 could not be found. Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 could not be found. Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 could not be found. Apr 12 10:54:58 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:54:58 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8b430f61-d75c-4577-9409-86eb27292917 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Returning 404 to user: Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:54:58 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8b430f61-d75c-4577-9409-86eb27292917 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" status: 404 len: 111 microversion: 2.87 time: 0.037174 Apr 12 10:54:58 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 288/879] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:54:58 2023] GET /compute/v2.1/servers/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:54:58 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:54:58 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:54:58 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:58 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:58 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:58 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:54:58 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0f55cab4-8530-4be0-a91d-65671f0dccd9" status: 204 len: 0 microversion: 2.87 time: 0.143547 Apr 12 10:54:58 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 299/880] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 10:54:58 2023] DELETE /compute/v2.1/servers/0f55cab4-8530-4be0-a91d-65671f0dccd9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 10:54:58 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:54:58 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-91380c83-ead1-4f54-a7d9-ea5c510cab18 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:54:58 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-91380c83-ead1-4f54-a7d9-ea5c510cab18 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:54:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-91380c83-ead1-4f54-a7d9-ea5c510cab18 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-91380c83-ead1-4f54-a7d9-ea5c510cab18 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-91380c83-ead1-4f54-a7d9-ea5c510cab18 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-91380c83-ead1-4f54-a7d9-ea5c510cab18 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-91380c83-ead1-4f54-a7d9-ea5c510cab18 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:58 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-91380c83-ead1-4f54-a7d9-ea5c510cab18 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:59 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-91380c83-ead1-4f54-a7d9-ea5c510cab18 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:54:59 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-91380c83-ead1-4f54-a7d9-ea5c510cab18 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:54:59 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-91380c83-ead1-4f54-a7d9-ea5c510cab18 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:54:59 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-91380c83-ead1-4f54-a7d9-ea5c510cab18 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f55cab4-8530-4be0-a91d-65671f0dccd9" status: 200 len: 1694 microversion: 2.87 time: 0.222976 Apr 12 10:54:59 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 294/881] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:54:58 2023] GET /compute/v2.1/servers/0f55cab4-8530-4be0-a91d-65671f0dccd9 => generated 1694 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 10:54:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95469ca9-8f8d-4755-8a00-4e2f5689f3de", "name": "network-vif-plugged", "status": "completed", "tag": "f3314b2f-1470-40cb-9699-71a5020d2bff"}, {"server_uuid": "0f55cab4-8530-4be0-a91d-65671f0dccd9", "name": "network-vif-unplugged", "status": "completed", "tag": "e1506948-cd44-4d78-a019-853199016229"}, {"server_uuid": "0f55cab4-8530-4be0-a91d-65671f0dccd9", "name": "network-vif-plugged", "status": "completed", "tag": "e1506948-cd44-4d78-a019-853199016229"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:54:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:54:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:54:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:54:59 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] Creating event network-vif-plugged:f3314b2f-1470-40cb-9699-71a5020d2bff for instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de on user Apr 12 10:54:59 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] Creating event network-vif-unplugged:e1506948-cd44-4d78-a019-853199016229 for instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 on user Apr 12 10:54:59 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] Creating event network-vif-plugged:e1506948-cd44-4d78-a019-853199016229 for instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 on user Apr 12 10:54:59 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.040833 Apr 12 10:54:59 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 289/882] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:54:59 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:55:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-1417e259-6e44-4bd2-8660-6a9d664e81b2 req-5e506e6d-e6e2-44e6-a909-6586c5bbf9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f55cab4-8530-4be0-a91d-65671f0dccd9", "name": "network-vif-deleted", "tag": "e1506948-cd44-4d78-a019-853199016229"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:55:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-1417e259-6e44-4bd2-8660-6a9d664e81b2 req-5e506e6d-e6e2-44e6-a909-6586c5bbf9ab service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-1417e259-6e44-4bd2-8660-6a9d664e81b2 req-5e506e6d-e6e2-44e6-a909-6586c5bbf9ab service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-1417e259-6e44-4bd2-8660-6a9d664e81b2 req-5e506e6d-e6e2-44e6-a909-6586c5bbf9ab service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-1417e259-6e44-4bd2-8660-6a9d664e81b2 req-5e506e6d-e6e2-44e6-a909-6586c5bbf9ab service nova] Creating event network-vif-deleted:e1506948-cd44-4d78-a019-853199016229 for instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 on user Apr 12 10:55:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-1417e259-6e44-4bd2-8660-6a9d664e81b2 req-5e506e6d-e6e2-44e6-a909-6586c5bbf9ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049945 Apr 12 10:55:00 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 300/883] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:55:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:55:03 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:03 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:03 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:03 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:03 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:03 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:03 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:03 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:03 user devstack@n-api.service[61852]: DEBUG nova.objects.instance [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'services' on Instance uuid fcd57d3d-16cb-4b4e-8785-ae15027621a5 {{(pid=61852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:55:04 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5/os-volume_attachments/b178c67e-b2d3-4f88-a2f0-c78db142c223" status: 202 len: 0 microversion: 2.1 time: 0.193879 Apr 12 10:55:04 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 295/884] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 10:55:03 2023] DELETE /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5/os-volume_attachments/b178c67e-b2d3-4f88-a2f0-c78db142c223 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:55:04 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-e6aeeb5b-c1ac-4ca7-b227-45265e3184c2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:04 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-e6aeeb5b-c1ac-4ca7-b227-45265e3184c2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e6aeeb5b-c1ac-4ca7-b227-45265e3184c2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e6aeeb5b-c1ac-4ca7-b227-45265e3184c2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e6aeeb5b-c1ac-4ca7-b227-45265e3184c2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e6aeeb5b-c1ac-4ca7-b227-45265e3184c2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e6aeeb5b-c1ac-4ca7-b227-45265e3184c2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:04 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-e6aeeb5b-c1ac-4ca7-b227-45265e3184c2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:04 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-e6aeeb5b-c1ac-4ca7-b227-45265e3184c2 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066776 Apr 12 10:55:04 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 290/885] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:55:04 2023] GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:55:04 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-bef3ce1d-e5e6-407c-ae5e-31f5639f45d3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-632119673"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:55:04 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-bef3ce1d-e5e6-407c-ae5e-31f5639f45d3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bef3ce1d-e5e6-407c-ae5e-31f5639f45d3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bef3ce1d-e5e6-407c-ae5e-31f5639f45d3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bef3ce1d-e5e6-407c-ae5e-31f5639f45d3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bef3ce1d-e5e6-407c-ae5e-31f5639f45d3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bef3ce1d-e5e6-407c-ae5e-31f5639f45d3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:04 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bef3ce1d-e5e6-407c-ae5e-31f5639f45d3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:05 user devstack@n-api.service[61854]: INFO nova.network.security_group_api [None req-bef3ce1d-e5e6-407c-ae5e-31f5639f45d3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Removing security group 238ef89f-adfb-4094-8fda-7c23da4c89ba from port 66db319f-02d8-4e75-b71a-2b2d136671a9 Apr 12 10:55:05 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-bef3ce1d-e5e6-407c-ae5e-31f5639f45d3 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc/action" status: 202 len: 0 microversion: 2.1 time: 0.897168 Apr 12 10:55:05 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 301/886] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:55:04 2023] POST /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc/action => generated 0 bytes in 899 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:55:05 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-abe3b02d-e994-4153-81f8-3da8cf24b6dd req-7855383b-a080-4d97-ade9-a94afb0a830b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc51c71-9d3b-4957-b912-0666c68b46fc", "tag": "66db319f-02d8-4e75-b71a-2b2d136671a9"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:55:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-abe3b02d-e994-4153-81f8-3da8cf24b6dd req-7855383b-a080-4d97-ade9-a94afb0a830b service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-abe3b02d-e994-4153-81f8-3da8cf24b6dd req-7855383b-a080-4d97-ade9-a94afb0a830b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-abe3b02d-e994-4153-81f8-3da8cf24b6dd req-7855383b-a080-4d97-ade9-a94afb0a830b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:05 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-abe3b02d-e994-4153-81f8-3da8cf24b6dd req-7855383b-a080-4d97-ade9-a94afb0a830b service nova] Creating event network-changed:66db319f-02d8-4e75-b71a-2b2d136671a9 for instance cdc51c71-9d3b-4957-b912-0666c68b46fc on user Apr 12 10:55:05 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-abe3b02d-e994-4153-81f8-3da8cf24b6dd req-7855383b-a080-4d97-ade9-a94afb0a830b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029344 Apr 12 10:55:05 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 296/887] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:55:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:55:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:06 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-338a9869-a9fa-4697-ab5c-49431f84d09d req-be55a1b5-625c-431c-8d47-c5bd10e8e729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc51c71-9d3b-4957-b912-0666c68b46fc", "tag": "66db319f-02d8-4e75-b71a-2b2d136671a9"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:55:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-338a9869-a9fa-4697-ab5c-49431f84d09d req-be55a1b5-625c-431c-8d47-c5bd10e8e729 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-338a9869-a9fa-4697-ab5c-49431f84d09d req-be55a1b5-625c-431c-8d47-c5bd10e8e729 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-338a9869-a9fa-4697-ab5c-49431f84d09d req-be55a1b5-625c-431c-8d47-c5bd10e8e729 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-338a9869-a9fa-4697-ab5c-49431f84d09d req-be55a1b5-625c-431c-8d47-c5bd10e8e729 service nova] Creating event network-changed:66db319f-02d8-4e75-b71a-2b2d136671a9 for instance cdc51c71-9d3b-4957-b912-0666c68b46fc on user Apr 12 10:55:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-338a9869-a9fa-4697-ab5c-49431f84d09d req-be55a1b5-625c-431c-8d47-c5bd10e8e729 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036398 Apr 12 10:55:06 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 302/888] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:55:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:55:06 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'services' on Instance uuid cdc51c71-9d3b-4957-b912-0666c68b46fc {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:55:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc/os-volume_attachments/ab32971b-fad9-41b7-8447-224947e10d53" status: 202 len: 0 microversion: 2.1 time: 0.164942 Apr 12 10:55:07 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 291/889] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 10:55:06 2023] DELETE /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc/os-volume_attachments/ab32971b-fad9-41b7-8447-224947e10d53 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:55:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-63ab3775-4e51-4da9-98f9-b021218acdbc tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:07 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-63ab3775-4e51-4da9-98f9-b021218acdbc tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-63ab3775-4e51-4da9-98f9-b021218acdbc tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-63ab3775-4e51-4da9-98f9-b021218acdbc tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-63ab3775-4e51-4da9-98f9-b021218acdbc tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-63ab3775-4e51-4da9-98f9-b021218acdbc tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-63ab3775-4e51-4da9-98f9-b021218acdbc tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:07 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-63ab3775-4e51-4da9-98f9-b021218acdbc tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:07 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-63ab3775-4e51-4da9-98f9-b021218acdbc tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046833 Apr 12 10:55:07 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 297/890] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:55:07 2023] GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:55:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0168842b-2bd1-4ca4-b1c0-cfe5aa169b84 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:11 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-0168842b-2bd1-4ca4-b1c0-cfe5aa169b84 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:11 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0168842b-2bd1-4ca4-b1c0-cfe5aa169b84 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0168842b-2bd1-4ca4-b1c0-cfe5aa169b84 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0168842b-2bd1-4ca4-b1c0-cfe5aa169b84 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0168842b-2bd1-4ca4-b1c0-cfe5aa169b84 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0168842b-2bd1-4ca4-b1c0-cfe5aa169b84 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0168842b-2bd1-4ca4-b1c0-cfe5aa169b84 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:11 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-0168842b-2bd1-4ca4-b1c0-cfe5aa169b84 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] HTTP exception thrown: Cannot 'detach_volume' instance faa11b52-f2b6-45aa-937f-7468095ddb22 while it is in vm_state rescued Apr 12 10:55:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0168842b-2bd1-4ca4-b1c0-cfe5aa169b84 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Request method failure captured: Apr 12 10:55:11 user devstack@n-api.service[61854]: request: DELETE /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/os-volume_attachments/e7d3b210-cbed-4d4a-8f47-f68cd0560193 HTTP/1.1 Apr 12 10:55:11 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:55:11 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:55:11 user devstack@n-api.service[61854]: Connection: close Apr 12 10:55:11 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:55:11 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:55:11 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:55:11 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:55:11 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:55:11 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNosqGCy9LHgGo-Yndp_Ix86dPoADuTrnm_RImsbY43eqA9xWhvyiivJnioJ9z9p3RlxFBVMsvx400Bp1v_lrKGOZVyQ8-QQERpwxm8kerR5X4hr_sxNED11I87boYZJQ5SrrIjm9pfsA1H5fYaQPT7mBTJHETLyCcAwgOQ0Bd95rMsc Apr 12 10:55:11 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:55:11 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:55:11 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:55:11 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:55:11 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:55:11 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:55:11 user devstack@n-api.service[61854]: X-Project-Id: 2b39cd8e55b54a86a7784f2934273e20 Apr 12 10:55:11 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1632398833 Apr 12 10:55:11 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:55:11 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:55:11 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2b39cd8e55b54a86a7784f2934273e20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b39cd8e55b54a86a7784f2934273e20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b39cd8e55b54a86a7784f2934273e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:55:11 user devstack@n-api.service[61854]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1632398833 Apr 12 10:55:11 user devstack@n-api.service[61854]: X-Tenant-Id: 2b39cd8e55b54a86a7784f2934273e20 Apr 12 10:55:11 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1632398833 Apr 12 10:55:11 user devstack@n-api.service[61854]: X-User: tempest-ServerRescueNegativeTestJSON-1632398833-project-member Apr 12 10:55:11 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:55:11 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:55:11 user devstack@n-api.service[61854]: X-User-Id: abdf772f2c7341c29159b6f1f2ce7ccb Apr 12 10:55:11 user devstack@n-api.service[61854]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1632398833-project-member Apr 12 10:55:11 user devstack@n-api.service[61854]: method: > Apr 12 10:55:11 user devstack@n-api.service[61854]: exception: Cannot 'detach_volume' instance faa11b52-f2b6-45aa-937f-7468095ddb22 while it is in vm_state rescued Apr 12 10:55:11 user devstack@n-api.service[61854]: action_args: {'server_id': 'faa11b52-f2b6-45aa-937f-7468095ddb22', 'id': 'e7d3b210-cbed-4d4a-8f47-f68cd0560193'} Apr 12 10:55:11 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance faa11b52-f2b6-45aa-937f-7468095ddb22 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance faa11b52-f2b6-45aa-937f-7468095ddb22 while it is in vm_state rescued Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance faa11b52-f2b6-45aa-937f-7468095ddb22 while it is in vm_state rescued Apr 12 10:55:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:55:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0168842b-2bd1-4ca4-b1c0-cfe5aa169b84 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Returning 409 to user: Cannot 'detach_volume' instance faa11b52-f2b6-45aa-937f-7468095ddb22 while it is in vm_state rescued {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:55:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-0168842b-2bd1-4ca4-b1c0-cfe5aa169b84 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/os-volume_attachments/e7d3b210-cbed-4d4a-8f47-f68cd0560193" status: 409 len: 152 microversion: 2.1 time: 0.120945 Apr 12 10:55:11 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 303/891] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 10:55:11 2023] DELETE /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/os-volume_attachments/e7d3b210-cbed-4d4a-8f47-f68cd0560193 => generated 152 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 10:55:11 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-09362c88-139a-42cc-bab2-d3286238f2ac tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:55:11 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-09362c88-139a-42cc-bab2-d3286238f2ac tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:11 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=23 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-09362c88-139a-42cc-bab2-d3286238f2ac tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-09362c88-139a-42cc-bab2-d3286238f2ac tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-09362c88-139a-42cc-bab2-d3286238f2ac tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-09362c88-139a-42cc-bab2-d3286238f2ac tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-09362c88-139a-42cc-bab2-d3286238f2ac tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-09362c88-139a-42cc-bab2-d3286238f2ac tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:11 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:11 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-09362c88-139a-42cc-bab2-d3286238f2ac tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "POST /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/action" status: 202 len: 0 microversion: 2.1 time: 0.192904 Apr 12 10:55:11 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 292/892] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:55:11 2023] POST /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:55:11 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-37eb79af-50a0-4361-9e17-a4f1b17117de tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:11 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-37eb79af-50a0-4361-9e17-a4f1b17117de tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:11 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-37eb79af-50a0-4361-9e17-a4f1b17117de tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-37eb79af-50a0-4361-9e17-a4f1b17117de tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-37eb79af-50a0-4361-9e17-a4f1b17117de tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-37eb79af-50a0-4361-9e17-a4f1b17117de tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-37eb79af-50a0-4361-9e17-a4f1b17117de tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-37eb79af-50a0-4361-9e17-a4f1b17117de tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:11 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-37eb79af-50a0-4361-9e17-a4f1b17117de tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:55:11 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-37eb79af-50a0-4361-9e17-a4f1b17117de tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22" status: 200 len: 1713 microversion: 2.1 time: 0.212154 Apr 12 10:55:11 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 298/893] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:55:11 2023] GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22 => generated 1713 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:55:12 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-d443a66c-96b7-408b-906c-3dcb2cbbeee1 req-49a41dc4-d423-40e4-b3cf-5fd190e1926f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa11b52-f2b6-45aa-937f-7468095ddb22", "name": "network-vif-unplugged", "status": "completed", "tag": "46213af2-2a93-4502-9f35-eda3d5b9f7fc"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:55:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d443a66c-96b7-408b-906c-3dcb2cbbeee1 req-49a41dc4-d423-40e4-b3cf-5fd190e1926f service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d443a66c-96b7-408b-906c-3dcb2cbbeee1 req-49a41dc4-d423-40e4-b3cf-5fd190e1926f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d443a66c-96b7-408b-906c-3dcb2cbbeee1 req-49a41dc4-d423-40e4-b3cf-5fd190e1926f service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-d443a66c-96b7-408b-906c-3dcb2cbbeee1 req-49a41dc4-d423-40e4-b3cf-5fd190e1926f service nova] Creating event network-vif-unplugged:46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance faa11b52-f2b6-45aa-937f-7468095ddb22 on user Apr 12 10:55:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-d443a66c-96b7-408b-906c-3dcb2cbbeee1 req-49a41dc4-d423-40e4-b3cf-5fd190e1926f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041068 Apr 12 10:55:12 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 304/894] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:55:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:55:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa11b52-f2b6-45aa-937f-7468095ddb22", "name": "network-vif-plugged", "status": "completed", "tag": "46213af2-2a93-4502-9f35-eda3d5b9f7fc"}, {"server_uuid": "faa11b52-f2b6-45aa-937f-7468095ddb22", "name": "network-vif-plugged", "status": "completed", "tag": "46213af2-2a93-4502-9f35-eda3d5b9f7fc"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:55:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] Creating event network-vif-plugged:46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance faa11b52-f2b6-45aa-937f-7468095ddb22 on user Apr 12 10:55:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] Creating event network-vif-plugged:46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance faa11b52-f2b6-45aa-937f-7468095ddb22 on user Apr 12 10:55:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030836 Apr 12 10:55:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 293/895] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:55:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:55:16 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-4275cfff-e62b-4aec-8484-6453311f9027 req-eb896110-6dce-41ec-ab38-c0744f1dfba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa11b52-f2b6-45aa-937f-7468095ddb22", "name": "network-vif-plugged", "status": "completed", "tag": "46213af2-2a93-4502-9f35-eda3d5b9f7fc"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:55:16 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-4275cfff-e62b-4aec-8484-6453311f9027 req-eb896110-6dce-41ec-ab38-c0744f1dfba4 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:16 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-4275cfff-e62b-4aec-8484-6453311f9027 req-eb896110-6dce-41ec-ab38-c0744f1dfba4 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:16 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-4275cfff-e62b-4aec-8484-6453311f9027 req-eb896110-6dce-41ec-ab38-c0744f1dfba4 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:16 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-4275cfff-e62b-4aec-8484-6453311f9027 req-eb896110-6dce-41ec-ab38-c0744f1dfba4 service nova] Creating event network-vif-plugged:46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance faa11b52-f2b6-45aa-937f-7468095ddb22 on user Apr 12 10:55:16 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-4275cfff-e62b-4aec-8484-6453311f9027 req-eb896110-6dce-41ec-ab38-c0744f1dfba4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029932 Apr 12 10:55:16 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 299/896] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:55:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:55:29 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:29 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=7 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:29 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:55:29 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136/action" status: 204 len: 0 microversion: 2.1 time: 0.068657 Apr 12 10:55:29 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 305/897] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:55:29 2023] POST /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136/action => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:55:29 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:29 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:29 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-419c90b1-c3d1-4bbc-99bf-2382ec2eca8e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:29 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-419c90b1-c3d1-4bbc-99bf-2382ec2eca8e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-419c90b1-c3d1-4bbc-99bf-2382ec2eca8e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-419c90b1-c3d1-4bbc-99bf-2382ec2eca8e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-419c90b1-c3d1-4bbc-99bf-2382ec2eca8e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-419c90b1-c3d1-4bbc-99bf-2382ec2eca8e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-419c90b1-c3d1-4bbc-99bf-2382ec2eca8e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:29 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-419c90b1-c3d1-4bbc-99bf-2382ec2eca8e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:29 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-419c90b1-c3d1-4bbc-99bf-2382ec2eca8e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:55:29 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-419c90b1-c3d1-4bbc-99bf-2382ec2eca8e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136" status: 200 len: 1555 microversion: 2.1 time: 0.219930 Apr 12 10:55:29 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 294/898] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:55:29 2023] GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136 => generated 1555 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:55:38 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=3 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:38 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:38 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-d7b9e980-b43c-44bb-a083-72f220fa1b58 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:38 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-d7b9e980-b43c-44bb-a083-72f220fa1b58 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d7b9e980-b43c-44bb-a083-72f220fa1b58 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d7b9e980-b43c-44bb-a083-72f220fa1b58 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d7b9e980-b43c-44bb-a083-72f220fa1b58 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d7b9e980-b43c-44bb-a083-72f220fa1b58 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d7b9e980-b43c-44bb-a083-72f220fa1b58 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:38 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-d7b9e980-b43c-44bb-a083-72f220fa1b58 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:38 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-d7b9e980-b43c-44bb-a083-72f220fa1b58 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:55:38 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-d7b9e980-b43c-44bb-a083-72f220fa1b58 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de" status: 200 len: 1441 microversion: 2.1 time: 0.230105 Apr 12 10:55:38 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 300/899] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:55:38 2023] GET /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de => generated 1441 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:55:39 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:39 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:39 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f758bc85-1b7b-4d5b-8ff2-25b64104a560 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:39 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f758bc85-1b7b-4d5b-8ff2-25b64104a560 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f758bc85-1b7b-4d5b-8ff2-25b64104a560 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f758bc85-1b7b-4d5b-8ff2-25b64104a560 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f758bc85-1b7b-4d5b-8ff2-25b64104a560 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f758bc85-1b7b-4d5b-8ff2-25b64104a560 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f758bc85-1b7b-4d5b-8ff2-25b64104a560 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:39 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f758bc85-1b7b-4d5b-8ff2-25b64104a560 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:40 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-f758bc85-1b7b-4d5b-8ff2-25b64104a560 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6576467073e41e9b497097d5a8dfd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9878bfe34ceb4a6695b253ad161c4f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:55:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f758bc85-1b7b-4d5b-8ff2-25b64104a560 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644" status: 200 len: 1689 microversion: 2.1 time: 0.226381 Apr 12 10:55:40 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 306/900] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:55:39 2023] GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644 => generated 1689 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:55:49 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3bee419c-beaa-43cb-a1e6-481a26281da5 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:49 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-3bee419c-beaa-43cb-a1e6-481a26281da5 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:49 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:49 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3bee419c-beaa-43cb-a1e6-481a26281da5 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3bee419c-beaa-43cb-a1e6-481a26281da5 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3bee419c-beaa-43cb-a1e6-481a26281da5 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3bee419c-beaa-43cb-a1e6-481a26281da5 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3bee419c-beaa-43cb-a1e6-481a26281da5 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-3bee419c-beaa-43cb-a1e6-481a26281da5 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:49 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-3bee419c-beaa-43cb-a1e6-481a26281da5 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] HTTP exception thrown: Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 could not be found. Apr 12 10:55:49 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3bee419c-beaa-43cb-a1e6-481a26281da5 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Request method failure captured: Apr 12 10:55:49 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/0f55cab4-8530-4be0-a91d-65671f0dccd9 HTTP/1.1 Apr 12 10:55:49 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:55:49 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:55:49 user devstack@n-api.service[61853]: Connection: close Apr 12 10:55:49 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:55:49 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:55:49 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:55:49 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:55:49 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:55:49 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolqGozV0Qu6SZmLnBoQNVS50cJGXvsoBmeV4kYNwwYJArQIYSrdoUYOhzr6a5xIwwWeKJWDA_aJ_7UXxKKH2gGl3NJVdJUiMFH66pZ8ZO9-s58wWiuTldpVpc8BUrzPWh_ozOVgQS7bUcGiqoIkH32PPxJ3U-ltY7mPcX2o4oUd4oc Apr 12 10:55:49 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:55:49 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:55:49 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:55:49 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:55:49 user devstack@n-api.service[61853]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 10:55:49 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:55:49 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:55:49 user devstack@n-api.service[61853]: X-Project-Id: 3789b59ccc704f86afac83af21fd84f9 Apr 12 10:55:49 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1826285115 Apr 12 10:55:49 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:55:49 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:55:49 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3789b59ccc704f86afac83af21fd84f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3789b59ccc704f86afac83af21fd84f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3789b59ccc704f86afac83af21fd84f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:55:49 user devstack@n-api.service[61853]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1826285115 Apr 12 10:55:49 user devstack@n-api.service[61853]: X-Tenant-Id: 3789b59ccc704f86afac83af21fd84f9 Apr 12 10:55:49 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1826285115 Apr 12 10:55:49 user devstack@n-api.service[61853]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member Apr 12 10:55:49 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:55:49 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:55:49 user devstack@n-api.service[61853]: X-User-Id: ba49b947c74e48f3b161b6f9fce8b1c5 Apr 12 10:55:49 user devstack@n-api.service[61853]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member Apr 12 10:55:49 user devstack@n-api.service[61853]: method: > Apr 12 10:55:49 user devstack@n-api.service[61853]: exception: Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 could not be found. Apr 12 10:55:49 user devstack@n-api.service[61853]: action_args: {'id': '0f55cab4-8530-4be0-a91d-65671f0dccd9'} Apr 12 10:55:49 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 could not be found. Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 could not be found. Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 could not be found. Apr 12 10:55:49 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:55:49 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3bee419c-beaa-43cb-a1e6-481a26281da5 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Returning 404 to user: Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:55:49 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-3bee419c-beaa-43cb-a1e6-481a26281da5 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f55cab4-8530-4be0-a91d-65671f0dccd9" status: 404 len: 111 microversion: 2.87 time: 0.043499 Apr 12 10:55:49 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 295/901] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 10:55:49 2023] GET /compute/v2.1/servers/0f55cab4-8530-4be0-a91d-65671f0dccd9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 10:55:53 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:53 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:53 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-f8a6c17d-2d8e-482f-bb5c-53a4ac1b20eb tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] Action: 'create', calling method: .version_select at 0x7fabbf86fc70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-26353819", "metadata": {"Type": "work"}}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:55:53 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-f8a6c17d-2d8e-482f-bb5c-53a4ac1b20eb tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.432704 Apr 12 10:55:53 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 301/902] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 10:55:53 2023] POST /compute/v2.1/os-volumes => generated 351 bytes in 437 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 12 10:55:53 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8d2b8397-1742-4bb9-9358-a6c4a8289c75 tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] Calling method '.version_select at 0x7fabbf938550>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:54 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:54 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:55:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8d2b8397-1742-4bb9-9358-a6c4a8289c75 tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1" status: 200 len: 351 microversion: 2.1 time: 0.075686 Apr 12 10:55:54 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 307/903] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 10:55:53 2023] GET /compute/v2.1/os-volumes/4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1 => generated 351 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:55:54 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b7fcc85e-6fc3-4b0c-abfb-3844dfe2dcb9 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:54 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b7fcc85e-6fc3-4b0c-abfb-3844dfe2dcb9 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b7fcc85e-6fc3-4b0c-abfb-3844dfe2dcb9 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b7fcc85e-6fc3-4b0c-abfb-3844dfe2dcb9 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b7fcc85e-6fc3-4b0c-abfb-3844dfe2dcb9 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b7fcc85e-6fc3-4b0c-abfb-3844dfe2dcb9 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b7fcc85e-6fc3-4b0c-abfb-3844dfe2dcb9 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b7fcc85e-6fc3-4b0c-abfb-3844dfe2dcb9 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:54 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b7fcc85e-6fc3-4b0c-abfb-3844dfe2dcb9 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057381 Apr 12 10:55:54 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 296/904] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:55:54 2023] GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 10:55:54 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:54 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:54 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:54 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:55:54 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5" status: 204 len: 0 microversion: 2.1 time: 0.140244 Apr 12 10:55:54 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 302/905] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:55:54 2023] DELETE /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:55:54 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7e0bd3bd-7ca8-4f3c-8ce3-3000d9feb7ff tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:54 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-7e0bd3bd-7ca8-4f3c-8ce3-3000d9feb7ff tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7e0bd3bd-7ca8-4f3c-8ce3-3000d9feb7ff tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7e0bd3bd-7ca8-4f3c-8ce3-3000d9feb7ff tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7e0bd3bd-7ca8-4f3c-8ce3-3000d9feb7ff tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7e0bd3bd-7ca8-4f3c-8ce3-3000d9feb7ff tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7e0bd3bd-7ca8-4f3c-8ce3-3000d9feb7ff tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7e0bd3bd-7ca8-4f3c-8ce3-3000d9feb7ff tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:54 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-7e0bd3bd-7ca8-4f3c-8ce3-3000d9feb7ff tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec47d3cdacb45e5a39509e76b546e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cecbfbfd5f42dbb663367f6fbdf3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:55:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-7e0bd3bd-7ca8-4f3c-8ce3-3000d9feb7ff tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5" status: 200 len: 1670 microversion: 2.1 time: 0.176159 Apr 12 10:55:54 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 308/906] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:55:54 2023] GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5 => generated 1670 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:55:54 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-dc60e6da-5479-4c28-8b13-9c31fdf0f6c2 req-3abc88c1-b5a6-4686-96b7-264e3390d42a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd57d3d-16cb-4b4e-8785-ae15027621a5", "name": "network-vif-unplugged", "status": "completed", "tag": "4372d146-13c3-4479-84ba-bdf514061696"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:55:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-dc60e6da-5479-4c28-8b13-9c31fdf0f6c2 req-3abc88c1-b5a6-4686-96b7-264e3390d42a service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-dc60e6da-5479-4c28-8b13-9c31fdf0f6c2 req-3abc88c1-b5a6-4686-96b7-264e3390d42a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:54 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-dc60e6da-5479-4c28-8b13-9c31fdf0f6c2 req-3abc88c1-b5a6-4686-96b7-264e3390d42a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:54 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-dc60e6da-5479-4c28-8b13-9c31fdf0f6c2 req-3abc88c1-b5a6-4686-96b7-264e3390d42a service nova] Creating event network-vif-unplugged:4372d146-13c3-4479-84ba-bdf514061696 for instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 on user Apr 12 10:55:54 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-dc60e6da-5479-4c28-8b13-9c31fdf0f6c2 req-3abc88c1-b5a6-4686-96b7-264e3390d42a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036623 Apr 12 10:55:54 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 297/907] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:55:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:55:55 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-20a9b37c-7b39-4758-b00f-ca6ea0fe17c4 tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] Calling method '.version_select at 0x7fabbf86cd30>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:55 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-20a9b37c-7b39-4758-b00f-ca6ea0fe17c4 tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1" status: 200 len: 352 microversion: 2.1 time: 0.051975 Apr 12 10:55:55 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 303/908] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 10:55:55 2023] GET /compute/v2.1/os-volumes/4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:55:55 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a42c7eb3-f8c9-45ed-81f7-900e95b25ce7 tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] Calling method '.version_select at 0x7fabbfc41c60>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:55 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a42c7eb3-f8c9-45ed-81f7-900e95b25ce7 tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1" status: 200 len: 352 microversion: 2.1 time: 0.048635 Apr 12 10:55:55 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 309/909] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 10:55:55 2023] GET /compute/v2.1/os-volumes/4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1 => generated 352 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:55:55 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-aeaa07c6-ee70-4580-9b06-3094349a43ca tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] Calling method '.version_select at 0x7fabbf6cf1c0>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:55 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-aeaa07c6-ee70-4580-9b06-3094349a43ca tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1" status: 202 len: 0 microversion: 2.1 time: 0.068264 Apr 12 10:55:55 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 298/910] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 10:55:55 2023] DELETE /compute/v2.1/os-volumes/4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:55:55 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-525d65eb-acb0-49d6-9a8f-bdb08686aca4 tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] Calling method '.version_select at 0x7fabbf8e57e0>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:55 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-525d65eb-acb0-49d6-9a8f-bdb08686aca4 tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1" status: 200 len: 351 microversion: 2.1 time: 0.051135 Apr 12 10:55:55 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 304/911] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 10:55:55 2023] GET /compute/v2.1/os-volumes/4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:55:55 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-5a5f6328-f5ff-4531-b6c4-3942b4b53b77 req-54eb7fbc-2157-48cf-a4e7-0702ff037760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd57d3d-16cb-4b4e-8785-ae15027621a5", "name": "network-vif-deleted", "tag": "4372d146-13c3-4479-84ba-bdf514061696"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:55:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5a5f6328-f5ff-4531-b6c4-3942b4b53b77 req-54eb7fbc-2157-48cf-a4e7-0702ff037760 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5a5f6328-f5ff-4531-b6c4-3942b4b53b77 req-54eb7fbc-2157-48cf-a4e7-0702ff037760 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:55 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5a5f6328-f5ff-4531-b6c4-3942b4b53b77 req-54eb7fbc-2157-48cf-a4e7-0702ff037760 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:56 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-5a5f6328-f5ff-4531-b6c4-3942b4b53b77 req-54eb7fbc-2157-48cf-a4e7-0702ff037760 service nova] Creating event network-vif-deleted:4372d146-13c3-4479-84ba-bdf514061696 for instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 on user Apr 12 10:55:56 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-5a5f6328-f5ff-4531-b6c4-3942b4b53b77 req-54eb7fbc-2157-48cf-a4e7-0702ff037760 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041650 Apr 12 10:55:56 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 310/912] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:55:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:55:56 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-59fb2a65-2b14-41d3-8df6-01d6377b514b tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] Calling method '.version_select at 0x7fabbf7b1240>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-59fb2a65-2b14-41d3-8df6-01d6377b514b tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1" status: 200 len: 351 microversion: 2.1 time: 0.061817 Apr 12 10:55:56 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 299/913] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 10:55:56 2023] GET /compute/v2.1/os-volumes/4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1 => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:55:56 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-231db428-488c-421b-9715-a476d58e27fa req-4bc0c8bf-3595-44b8-98d7-c985f20b7f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd57d3d-16cb-4b4e-8785-ae15027621a5", "name": "network-vif-plugged", "status": "completed", "tag": "4372d146-13c3-4479-84ba-bdf514061696"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:55:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-231db428-488c-421b-9715-a476d58e27fa req-4bc0c8bf-3595-44b8-98d7-c985f20b7f00 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-231db428-488c-421b-9715-a476d58e27fa req-4bc0c8bf-3595-44b8-98d7-c985f20b7f00 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:56 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-231db428-488c-421b-9715-a476d58e27fa req-4bc0c8bf-3595-44b8-98d7-c985f20b7f00 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:56 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-231db428-488c-421b-9715-a476d58e27fa req-4bc0c8bf-3595-44b8-98d7-c985f20b7f00 service nova] Creating event network-vif-plugged:4372d146-13c3-4479-84ba-bdf514061696 for instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 on user Apr 12 10:55:56 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-231db428-488c-421b-9715-a476d58e27fa req-4bc0c8bf-3595-44b8-98d7-c985f20b7f00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031763 Apr 12 10:55:56 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 305/914] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:55:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:55:57 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e30c14c9-ba20-400c-a518-faff39b2d2ab tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:57 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e30c14c9-ba20-400c-a518-faff39b2d2ab tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e30c14c9-ba20-400c-a518-faff39b2d2ab tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e30c14c9-ba20-400c-a518-faff39b2d2ab tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e30c14c9-ba20-400c-a518-faff39b2d2ab tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e30c14c9-ba20-400c-a518-faff39b2d2ab tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e30c14c9-ba20-400c-a518-faff39b2d2ab tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:57 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e30c14c9-ba20-400c-a518-faff39b2d2ab tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:57 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-e30c14c9-ba20-400c-a518-faff39b2d2ab tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.183770 Apr 12 10:55:57 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 311/915] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:55:57 2023] GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc/os-volume_attachments => generated 25 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 10:55:57 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b0fd1dce-2fc1-45ca-b96f-4c0b6358962f tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:57 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b0fd1dce-2fc1-45ca-b96f-4c0b6358962f tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b0fd1dce-2fc1-45ca-b96f-4c0b6358962f tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b0fd1dce-2fc1-45ca-b96f-4c0b6358962f tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b0fd1dce-2fc1-45ca-b96f-4c0b6358962f tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b0fd1dce-2fc1-45ca-b96f-4c0b6358962f tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b0fd1dce-2fc1-45ca-b96f-4c0b6358962f tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:57 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b0fd1dce-2fc1-45ca-b96f-4c0b6358962f tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:57 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-d8987b93-b7ac-406b-8a07-26b37d1c682d tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] Calling method '.version_select at 0x7fabbf55f520>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:57 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-b0fd1dce-2fc1-45ca-b96f-4c0b6358962f tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] HTTP exception thrown: Instance cdc51c71-9d3b-4957-b912-0666c68b46fc is not attached to volume ab32971b-fad9-41b7-8447-224947e10d53 Apr 12 10:55:57 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b0fd1dce-2fc1-45ca-b96f-4c0b6358962f tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Request method failure captured: Apr 12 10:55:57 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc/os-volume_attachments/ab32971b-fad9-41b7-8447-224947e10d53 HTTP/1.1 Apr 12 10:55:57 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:55:57 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:55:57 user devstack@n-api.service[61853]: Connection: close Apr 12 10:55:57 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:55:57 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:55:57 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:55:57 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:55:57 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:55:57 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNouwKaXaYhzw16o-0RmcYnB2vWXKp9V3tYvDadrCoi5enSg9cOgAwt8tJqWWBok9dqnjmTB2D-ZxTjJ_y3NnLll64p9kiYAUAwTGwJnB1xEAd70imb5w5FRbC8ttE3EjQl-W7mLs8xTx-jgIkSXAzVX82xeCBk1qBa6oFUWEA4HcNt0 Apr 12 10:55:57 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:55:57 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:55:57 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:55:57 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:55:57 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:55:57 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:55:57 user devstack@n-api.service[61853]: X-Project-Id: b467fac451ee466fb93cec3d3aa3b408 Apr 12 10:55:57 user devstack@n-api.service[61853]: X-Project-Name: tempest-TestMinimumBasicScenario-2095634766 Apr 12 10:55:57 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:55:57 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:55:57 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b467fac451ee466fb93cec3d3aa3b408"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b467fac451ee466fb93cec3d3aa3b408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b467fac451ee466fb93cec3d3aa3b408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:55:57 user devstack@n-api.service[61853]: X-Tenant: tempest-TestMinimumBasicScenario-2095634766 Apr 12 10:55:57 user devstack@n-api.service[61853]: X-Tenant-Id: b467fac451ee466fb93cec3d3aa3b408 Apr 12 10:55:57 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2095634766 Apr 12 10:55:57 user devstack@n-api.service[61853]: X-User: tempest-TestMinimumBasicScenario-2095634766-project-member Apr 12 10:55:57 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:55:57 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:55:57 user devstack@n-api.service[61853]: X-User-Id: a633ec4046a9467683cbfd2ebe59600f Apr 12 10:55:57 user devstack@n-api.service[61853]: X-User-Name: tempest-TestMinimumBasicScenario-2095634766-project-member Apr 12 10:55:57 user devstack@n-api.service[61853]: method: > Apr 12 10:55:57 user devstack@n-api.service[61853]: exception: Instance cdc51c71-9d3b-4957-b912-0666c68b46fc is not attached to volume ab32971b-fad9-41b7-8447-224947e10d53 Apr 12 10:55:57 user devstack@n-api.service[61853]: action_args: {'server_id': 'cdc51c71-9d3b-4957-b912-0666c68b46fc', 'id': 'ab32971b-fad9-41b7-8447-224947e10d53'} Apr 12 10:55:57 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ab32971b-fad9-41b7-8447-224947e10d53. Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdc51c71-9d3b-4957-b912-0666c68b46fc is not attached to volume ab32971b-fad9-41b7-8447-224947e10d53 Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdc51c71-9d3b-4957-b912-0666c68b46fc is not attached to volume ab32971b-fad9-41b7-8447-224947e10d53 Apr 12 10:55:57 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:55:57 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b0fd1dce-2fc1-45ca-b96f-4c0b6358962f tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Returning 404 to user: Instance cdc51c71-9d3b-4957-b912-0666c68b46fc is not attached to volume ab32971b-fad9-41b7-8447-224947e10d53 {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:55:57 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b0fd1dce-2fc1-45ca-b96f-4c0b6358962f tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc/os-volume_attachments/ab32971b-fad9-41b7-8447-224947e10d53" status: 404 len: 154 microversion: 2.1 time: 0.109096 Apr 12 10:55:57 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-d8987b93-b7ac-406b-8a07-26b37d1c682d tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] HTTP exception thrown: Volume 4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1 could not be found. Apr 12 10:55:57 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 300/916] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 10:55:57 2023] DELETE /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc/os-volume_attachments/ab32971b-fad9-41b7-8447-224947e10d53 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:55:57 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-d8987b93-b7ac-406b-8a07-26b37d1c682d tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] Request method failure captured: Apr 12 10:55:57 user devstack@n-api.service[61852]: request: GET /compute/v2.1/os-volumes/4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1 HTTP/1.1 Apr 12 10:55:57 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:55:57 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:55:57 user devstack@n-api.service[61852]: Connection: close Apr 12 10:55:57 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:55:57 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:55:57 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:55:57 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:55:57 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:55:57 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNo45ZfE2C_2WpHl4AwjvEqcfP1jha65097qkxMr3-nb2RgYK5683GwacJ2daqjX-uWWqZw-yR1671Uz9bOd8EI6n2etapfO259Oo1IVIfHRTs2rxlIZQW4trPURjRlWV749ncUuqnR5DPGPo5t-_GG1uNqADC76JFNHBMDlTKT0roZg Apr 12 10:55:57 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:55:57 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:55:57 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:55:57 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:55:57 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:55:57 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:55:57 user devstack@n-api.service[61852]: X-Project-Id: 516137ce6def44baa8d5d5f3c9ad6375 Apr 12 10:55:57 user devstack@n-api.service[61852]: X-Project-Name: tempest-VolumesGetTestJSON-2021076168 Apr 12 10:55:57 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:55:57 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:55:57 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/516137ce6def44baa8d5d5f3c9ad6375"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/516137ce6def44baa8d5d5f3c9ad6375"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/516137ce6def44baa8d5d5f3c9ad6375"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:55:57 user devstack@n-api.service[61852]: X-Tenant: tempest-VolumesGetTestJSON-2021076168 Apr 12 10:55:57 user devstack@n-api.service[61852]: X-Tenant-Id: 516137ce6def44baa8d5d5f3c9ad6375 Apr 12 10:55:57 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-VolumesGetTestJSON-2021076168 Apr 12 10:55:57 user devstack@n-api.service[61852]: X-User: tempest-VolumesGetTestJSON-2021076168-project-member Apr 12 10:55:57 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:55:57 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:55:57 user devstack@n-api.service[61852]: X-User-Id: 89e738b83a514d5eb5ef64c0b8822178 Apr 12 10:55:57 user devstack@n-api.service[61852]: X-User-Name: tempest-VolumesGetTestJSON-2021076168-project-member Apr 12 10:55:57 user devstack@n-api.service[61852]: method: Apr 12 10:55:57 user devstack@n-api.service[61852]: exception: Volume 4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1 could not be found. Apr 12 10:55:57 user devstack@n-api.service[61852]: action_args: {'id': '4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1'} Apr 12 10:55:57 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1 could not be found. (HTTP 404) (Request-ID: req-05cc9e31-6195-4ecc-a610-07d5faa6afec) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1 could not be found. Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1 could not be found. Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1 could not be found. Apr 12 10:55:57 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:55:57 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-d8987b93-b7ac-406b-8a07-26b37d1c682d tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] Returning 404 to user: Volume 4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:55:57 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-d8987b93-b7ac-406b-8a07-26b37d1c682d tempest-VolumesGetTestJSON-2021076168 tempest-VolumesGetTestJSON-2021076168-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1" status: 404 len: 109 microversion: 2.1 time: 0.037237 Apr 12 10:55:57 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 306/917] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 10:55:57 2023] GET /compute/v2.1/os-volumes/4ef8b4ad-1919-4bdb-8c42-ffe2a41b50f1 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:55:59 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:59 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:59 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:59 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:55:59 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc" status: 204 len: 0 microversion: 2.1 time: 0.132614 Apr 12 10:55:59 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 312/918] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:55:59 2023] DELETE /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:55:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-40e84d84-2522-4495-8911-eda44a4bc16e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:55:59 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-40e84d84-2522-4495-8911-eda44a4bc16e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:55:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-40e84d84-2522-4495-8911-eda44a4bc16e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-40e84d84-2522-4495-8911-eda44a4bc16e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-40e84d84-2522-4495-8911-eda44a4bc16e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:55:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-40e84d84-2522-4495-8911-eda44a4bc16e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:55:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-40e84d84-2522-4495-8911-eda44a4bc16e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:55:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-40e84d84-2522-4495-8911-eda44a4bc16e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:00 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-5a891a40-7a3f-49ab-83c7-02d5b9d3a5ff req-8ad7cbad-851a-48ef-890b-d4286798a3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc51c71-9d3b-4957-b912-0666c68b46fc", "name": "network-vif-unplugged", "status": "completed", "tag": "66db319f-02d8-4e75-b71a-2b2d136671a9"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:56:00 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-40e84d84-2522-4495-8911-eda44a4bc16e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:56:00 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-5a891a40-7a3f-49ab-83c7-02d5b9d3a5ff req-8ad7cbad-851a-48ef-890b-d4286798a3b6 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:00 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-5a891a40-7a3f-49ab-83c7-02d5b9d3a5ff req-8ad7cbad-851a-48ef-890b-d4286798a3b6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:00 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-5a891a40-7a3f-49ab-83c7-02d5b9d3a5ff req-8ad7cbad-851a-48ef-890b-d4286798a3b6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:00 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-40e84d84-2522-4495-8911-eda44a4bc16e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc" status: 200 len: 1542 microversion: 2.1 time: 0.269513 Apr 12 10:56:00 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 301/919] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:55:59 2023] GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc => generated 1542 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:56:00 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-5a891a40-7a3f-49ab-83c7-02d5b9d3a5ff req-8ad7cbad-851a-48ef-890b-d4286798a3b6 service nova] Creating event network-vif-unplugged:66db319f-02d8-4e75-b71a-2b2d136671a9 for instance cdc51c71-9d3b-4957-b912-0666c68b46fc on user Apr 12 10:56:00 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-5a891a40-7a3f-49ab-83c7-02d5b9d3a5ff req-8ad7cbad-851a-48ef-890b-d4286798a3b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036455 Apr 12 10:56:00 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 307/920] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:56:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 10:56:01 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-3c860943-8aea-4239-9955-12c3e7f6e773 req-8503cf7b-54f5-4a64-95ec-0bb05cce62e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc51c71-9d3b-4957-b912-0666c68b46fc", "name": "network-vif-deleted", "tag": "66db319f-02d8-4e75-b71a-2b2d136671a9"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:56:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3c860943-8aea-4239-9955-12c3e7f6e773 req-8503cf7b-54f5-4a64-95ec-0bb05cce62e4 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3c860943-8aea-4239-9955-12c3e7f6e773 req-8503cf7b-54f5-4a64-95ec-0bb05cce62e4 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:01 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3c860943-8aea-4239-9955-12c3e7f6e773 req-8503cf7b-54f5-4a64-95ec-0bb05cce62e4 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:01 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-3c860943-8aea-4239-9955-12c3e7f6e773 req-8503cf7b-54f5-4a64-95ec-0bb05cce62e4 service nova] Creating event network-vif-deleted:66db319f-02d8-4e75-b71a-2b2d136671a9 for instance cdc51c71-9d3b-4957-b912-0666c68b46fc on user Apr 12 10:56:01 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-3c860943-8aea-4239-9955-12c3e7f6e773 req-8503cf7b-54f5-4a64-95ec-0bb05cce62e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031129 Apr 12 10:56:01 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 313/921] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:56:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:56:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b0aacb84-0151-4556-8c18-f525e4e8a49a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:56:01 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b0aacb84-0151-4556-8c18-f525e4e8a49a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:56:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b0aacb84-0151-4556-8c18-f525e4e8a49a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b0aacb84-0151-4556-8c18-f525e4e8a49a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b0aacb84-0151-4556-8c18-f525e4e8a49a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b0aacb84-0151-4556-8c18-f525e4e8a49a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b0aacb84-0151-4556-8c18-f525e4e8a49a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b0aacb84-0151-4556-8c18-f525e4e8a49a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:02 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-b0aacb84-0151-4556-8c18-f525e4e8a49a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:56:02 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b0aacb84-0151-4556-8c18-f525e4e8a49a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22" status: 200 len: 1719 microversion: 2.1 time: 0.165980 Apr 12 10:56:02 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 302/922] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:56:01 2023] GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:56:02 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-b431979e-3048-4e21-afc0-e210fe501a58 req-1154dd4e-2751-43ee-93f2-7f8364182fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc51c71-9d3b-4957-b912-0666c68b46fc", "name": "network-vif-plugged", "status": "completed", "tag": "66db319f-02d8-4e75-b71a-2b2d136671a9"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:56:02 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-b431979e-3048-4e21-afc0-e210fe501a58 req-1154dd4e-2751-43ee-93f2-7f8364182fef service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:02 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-b431979e-3048-4e21-afc0-e210fe501a58 req-1154dd4e-2751-43ee-93f2-7f8364182fef service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:02 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-b431979e-3048-4e21-afc0-e210fe501a58 req-1154dd4e-2751-43ee-93f2-7f8364182fef service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:02 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-b431979e-3048-4e21-afc0-e210fe501a58 req-1154dd4e-2751-43ee-93f2-7f8364182fef service nova] Creating event network-vif-plugged:66db319f-02d8-4e75-b71a-2b2d136671a9 for instance cdc51c71-9d3b-4957-b912-0666c68b46fc on user Apr 12 10:56:02 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-b431979e-3048-4e21-afc0-e210fe501a58 req-1154dd4e-2751-43ee-93f2-7f8364182fef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035836 Apr 12 10:56:02 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 308/923] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:56:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:56:19 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:56:19 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:56:19 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-080bc796-a960-454c-ae2d-a00058101564 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:56:19 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-080bc796-a960-454c-ae2d-a00058101564 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:56:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-080bc796-a960-454c-ae2d-a00058101564 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-080bc796-a960-454c-ae2d-a00058101564 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-080bc796-a960-454c-ae2d-a00058101564 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-080bc796-a960-454c-ae2d-a00058101564 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-080bc796-a960-454c-ae2d-a00058101564 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-080bc796-a960-454c-ae2d-a00058101564 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:19 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-080bc796-a960-454c-ae2d-a00058101564 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:56:19 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-080bc796-a960-454c-ae2d-a00058101564 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136" status: 200 len: 1547 microversion: 2.1 time: 0.290751 Apr 12 10:56:19 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 314/924] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:56:19 2023] GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136 => generated 1547 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:56:39 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=12 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:56:39 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=28 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:56:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-24aa9bbf-b3f4-445b-958a-1bc1b3ce32ae tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:56:39 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-24aa9bbf-b3f4-445b-958a-1bc1b3ce32ae tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:56:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-24aa9bbf-b3f4-445b-958a-1bc1b3ce32ae tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-24aa9bbf-b3f4-445b-958a-1bc1b3ce32ae tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-24aa9bbf-b3f4-445b-958a-1bc1b3ce32ae tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-24aa9bbf-b3f4-445b-958a-1bc1b3ce32ae tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-24aa9bbf-b3f4-445b-958a-1bc1b3ce32ae tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-24aa9bbf-b3f4-445b-958a-1bc1b3ce32ae tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:39 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-24aa9bbf-b3f4-445b-958a-1bc1b3ce32ae tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:56:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-24aa9bbf-b3f4-445b-958a-1bc1b3ce32ae tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de" status: 200 len: 1441 microversion: 2.1 time: 0.622414 Apr 12 10:56:39 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 303/925] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:56:39 2023] GET /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de => generated 1441 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:56:40 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:56:40 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:56:40 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:56:40 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:40 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:40 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:40 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Going to try to start instance {{(pid=61852) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 12 10:56:40 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644/action" status: 202 len: 0 microversion: 2.1 time: 0.119439 Apr 12 10:56:40 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 309/926] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:56:40 2023] POST /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:56:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d02fa331-221b-41e4-a99e-b308ba13ce61 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:56:40 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d02fa331-221b-41e4-a99e-b308ba13ce61 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:56:40 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:56:40 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:56:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d02fa331-221b-41e4-a99e-b308ba13ce61 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d02fa331-221b-41e4-a99e-b308ba13ce61 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d02fa331-221b-41e4-a99e-b308ba13ce61 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d02fa331-221b-41e4-a99e-b308ba13ce61 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d02fa331-221b-41e4-a99e-b308ba13ce61 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d02fa331-221b-41e4-a99e-b308ba13ce61 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:40 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-d02fa331-221b-41e4-a99e-b308ba13ce61 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6576467073e41e9b497097d5a8dfd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9878bfe34ceb4a6695b253ad161c4f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:56:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d02fa331-221b-41e4-a99e-b308ba13ce61 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644" status: 200 len: 1698 microversion: 2.1 time: 0.186272 Apr 12 10:56:40 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 315/927] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:56:40 2023] GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644 => generated 1698 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:56:41 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-d9d7d633-7589-4136-a0f7-f47cd7713693 req-75758ca6-f300-42f7-9966-c94fc03a4ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95469ca9-8f8d-4755-8a00-4e2f5689f3de", "tag": "f3314b2f-1470-40cb-9699-71a5020d2bff"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:56:41 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:56:41 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:56:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d9d7d633-7589-4136-a0f7-f47cd7713693 req-75758ca6-f300-42f7-9966-c94fc03a4ac3 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d9d7d633-7589-4136-a0f7-f47cd7713693 req-75758ca6-f300-42f7-9966-c94fc03a4ac3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d9d7d633-7589-4136-a0f7-f47cd7713693 req-75758ca6-f300-42f7-9966-c94fc03a4ac3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-d9d7d633-7589-4136-a0f7-f47cd7713693 req-75758ca6-f300-42f7-9966-c94fc03a4ac3 service nova] Creating event network-changed:f3314b2f-1470-40cb-9699-71a5020d2bff for instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de on user Apr 12 10:56:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-d9d7d633-7589-4136-a0f7-f47cd7713693 req-75758ca6-f300-42f7-9966-c94fc03a4ac3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200630 Apr 12 10:56:41 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 304/928] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:56:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:56:41 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:56:42 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de" status: 204 len: 0 microversion: 2.1 time: 0.126773 Apr 12 10:56:42 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 310/929] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:56:41 2023] DELETE /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:56:42 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9645d6d6-7c9a-4430-bef9-6e17db622c5c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:56:42 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9645d6d6-7c9a-4430-bef9-6e17db622c5c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:56:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9645d6d6-7c9a-4430-bef9-6e17db622c5c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9645d6d6-7c9a-4430-bef9-6e17db622c5c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9645d6d6-7c9a-4430-bef9-6e17db622c5c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9645d6d6-7c9a-4430-bef9-6e17db622c5c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9645d6d6-7c9a-4430-bef9-6e17db622c5c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9645d6d6-7c9a-4430-bef9-6e17db622c5c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:42 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-9645d6d6-7c9a-4430-bef9-6e17db622c5c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:56:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9645d6d6-7c9a-4430-bef9-6e17db622c5c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de" status: 200 len: 1447 microversion: 2.1 time: 0.281650 Apr 12 10:56:42 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 316/930] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:56:42 2023] GET /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de => generated 1447 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:56:42 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-528b5a72-1ffd-4047-a7df-d2ded44f82ae req-d36e4bfb-05b8-4c91-8562-022501a1e47b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95469ca9-8f8d-4755-8a00-4e2f5689f3de", "name": "network-vif-unplugged", "status": "completed", "tag": "f3314b2f-1470-40cb-9699-71a5020d2bff"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:56:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-528b5a72-1ffd-4047-a7df-d2ded44f82ae req-d36e4bfb-05b8-4c91-8562-022501a1e47b service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-528b5a72-1ffd-4047-a7df-d2ded44f82ae req-d36e4bfb-05b8-4c91-8562-022501a1e47b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:42 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-528b5a72-1ffd-4047-a7df-d2ded44f82ae req-d36e4bfb-05b8-4c91-8562-022501a1e47b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-528b5a72-1ffd-4047-a7df-d2ded44f82ae req-d36e4bfb-05b8-4c91-8562-022501a1e47b service nova] Creating event network-vif-unplugged:f3314b2f-1470-40cb-9699-71a5020d2bff for instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de on user Apr 12 10:56:42 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-528b5a72-1ffd-4047-a7df-d2ded44f82ae req-d36e4bfb-05b8-4c91-8562-022501a1e47b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028639 Apr 12 10:56:42 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 305/931] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:56:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:56:44 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-3823279f-e050-48cd-87fe-fa5d2ed38d84 req-69fef239-9e3a-48fa-94c3-883b57e7c216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95469ca9-8f8d-4755-8a00-4e2f5689f3de", "name": "network-vif-deleted", "tag": "f3314b2f-1470-40cb-9699-71a5020d2bff"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:56:44 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95469ca9-8f8d-4755-8a00-4e2f5689f3de", "name": "network-vif-plugged", "status": "completed", "tag": "f3314b2f-1470-40cb-9699-71a5020d2bff"}, {"server_uuid": "95469ca9-8f8d-4755-8a00-4e2f5689f3de", "name": "network-vif-plugged", "status": "completed", "tag": "f3314b2f-1470-40cb-9699-71a5020d2bff"}, {"server_uuid": "95469ca9-8f8d-4755-8a00-4e2f5689f3de", "name": "network-vif-plugged", "status": "completed", "tag": "f3314b2f-1470-40cb-9699-71a5020d2bff"}, {"server_uuid": "95469ca9-8f8d-4755-8a00-4e2f5689f3de", "name": "network-vif-unplugged", "status": "completed", "tag": "f3314b2f-1470-40cb-9699-71a5020d2bff"}, {"server_uuid": "95469ca9-8f8d-4755-8a00-4e2f5689f3de", "name": "network-vif-plugged", "status": "completed", "tag": "f3314b2f-1470-40cb-9699-71a5020d2bff"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:56:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3823279f-e050-48cd-87fe-fa5d2ed38d84 req-69fef239-9e3a-48fa-94c3-883b57e7c216 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3823279f-e050-48cd-87fe-fa5d2ed38d84 req-69fef239-9e3a-48fa-94c3-883b57e7c216 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3823279f-e050-48cd-87fe-fa5d2ed38d84 req-69fef239-9e3a-48fa-94c3-883b57e7c216 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:44 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-3823279f-e050-48cd-87fe-fa5d2ed38d84 req-69fef239-9e3a-48fa-94c3-883b57e7c216 service nova] Creating event network-vif-deleted:f3314b2f-1470-40cb-9699-71a5020d2bff for instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de on user Apr 12 10:56:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-3823279f-e050-48cd-87fe-fa5d2ed38d84 req-69fef239-9e3a-48fa-94c3-883b57e7c216 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031654 Apr 12 10:56:44 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 317/932] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:56:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:56:44 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Creating event network-vif-plugged:f3314b2f-1470-40cb-9699-71a5020d2bff for instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de on user Apr 12 10:56:44 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Creating event network-vif-plugged:f3314b2f-1470-40cb-9699-71a5020d2bff for instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de on user Apr 12 10:56:44 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Creating event network-vif-plugged:f3314b2f-1470-40cb-9699-71a5020d2bff for instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de on user Apr 12 10:56:44 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Creating event network-vif-unplugged:f3314b2f-1470-40cb-9699-71a5020d2bff for instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de on user Apr 12 10:56:44 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Creating event network-vif-plugged:f3314b2f-1470-40cb-9699-71a5020d2bff for instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de on user Apr 12 10:56:44 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.117146 Apr 12 10:56:44 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 311/933] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:56:44 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:56:44 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-6968f490-3c59-4461-a032-c501c1359d6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:56:44 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-6968f490-3c59-4461-a032-c501c1359d6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:56:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6968f490-3c59-4461-a032-c501c1359d6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6968f490-3c59-4461-a032-c501c1359d6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6968f490-3c59-4461-a032-c501c1359d6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6968f490-3c59-4461-a032-c501c1359d6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6968f490-3c59-4461-a032-c501c1359d6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6968f490-3c59-4461-a032-c501c1359d6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-6968f490-3c59-4461-a032-c501c1359d6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] HTTP exception thrown: Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 could not be found. Apr 12 10:56:44 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-6968f490-3c59-4461-a032-c501c1359d6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Request method failure captured: Apr 12 10:56:44 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5 HTTP/1.1 Apr 12 10:56:44 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:56:44 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:56:44 user devstack@n-api.service[61853]: Connection: close Apr 12 10:56:44 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:56:44 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:56:44 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:56:44 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:56:44 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:56:44 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNosjxmxcVjmUpCMLAxdRdLndUlKxh4MkCcirUvRtNoND63IGb1xoGABQC8D9rLRE4dW_L0z2oNcBU8jtABVmL5XlYtTU15Uvd1NUbrH9hi6BA13fINZDRHpVQlP0DCe8J969vT87xyN1x_qfcLnOr5CvtvwcJHsWkRykm4XG-p9tMms Apr 12 10:56:44 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:56:44 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:56:44 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:56:44 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:56:44 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:56:44 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:56:44 user devstack@n-api.service[61853]: X-Project-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:56:44 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:44 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:56:44 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:56:44 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:56:44 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:44 user devstack@n-api.service[61853]: X-Tenant-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:56:44 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:44 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:56:44 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:56:44 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:56:44 user devstack@n-api.service[61853]: X-User-Id: 7ec47d3cdacb45e5a39509e76b546e34 Apr 12 10:56:44 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:56:44 user devstack@n-api.service[61853]: method: > Apr 12 10:56:44 user devstack@n-api.service[61853]: exception: Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 could not be found. Apr 12 10:56:44 user devstack@n-api.service[61853]: action_args: {'id': 'fcd57d3d-16cb-4b4e-8785-ae15027621a5'} Apr 12 10:56:44 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 could not be found. Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 could not be found. Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 could not be found. Apr 12 10:56:44 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:44 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-6968f490-3c59-4461-a032-c501c1359d6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Returning 404 to user: Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:56:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-6968f490-3c59-4461-a032-c501c1359d6f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5" status: 404 len: 111 microversion: 2.1 time: 0.032949 Apr 12 10:56:44 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 306/934] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:56:44 2023] GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:56:44 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d331820e-4929-4ae1-b00a-7231840e4651 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '.version_select at 0x7fabbf649990>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:56:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d331820e-4929-4ae1-b00a-7231840e4651 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1567303486" status: 202 len: 0 microversion: 2.1 time: 0.025107 Apr 12 10:56:44 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 318/935] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 10:56:44 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1567303486 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:56:46 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aef35e7-5daf-4d41-b91b-a7ff4a481644", "name": "network-vif-plugged", "status": "completed", "tag": "8786a087-f036-403b-9b82-c75fc6dbb110"}, {"server_uuid": "2aef35e7-5daf-4d41-b91b-a7ff4a481644", "name": "network-vif-plugged", "status": "completed", "tag": "8786a087-f036-403b-9b82-c75fc6dbb110"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:56:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] Creating event network-vif-plugged:8786a087-f036-403b-9b82-c75fc6dbb110 for instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 on user Apr 12 10:56:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] Creating event network-vif-plugged:8786a087-f036-403b-9b82-c75fc6dbb110 for instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 on user Apr 12 10:56:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030077 Apr 12 10:56:46 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 312/936] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:56:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:56:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b3c560dd-ee95-42ad-8228-853ca64e58bf tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:56:47 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b3c560dd-ee95-42ad-8228-853ca64e58bf tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:56:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b3c560dd-ee95-42ad-8228-853ca64e58bf tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b3c560dd-ee95-42ad-8228-853ca64e58bf tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b3c560dd-ee95-42ad-8228-853ca64e58bf tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b3c560dd-ee95-42ad-8228-853ca64e58bf tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b3c560dd-ee95-42ad-8228-853ca64e58bf tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:47 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b3c560dd-ee95-42ad-8228-853ca64e58bf tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-b3c560dd-ee95-42ad-8228-853ca64e58bf tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] HTTP exception thrown: Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 could not be found. Apr 12 10:56:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b3c560dd-ee95-42ad-8228-853ca64e58bf tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Request method failure captured: Apr 12 10:56:47 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5 HTTP/1.1 Apr 12 10:56:47 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:56:47 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:56:47 user devstack@n-api.service[61853]: Connection: close Apr 12 10:56:47 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:56:47 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:56:47 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:56:47 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:56:47 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:56:47 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNosjxmxcVjmUpCMLAxdRdLndUlKxh4MkCcirUvRtNoND63IGb1xoGABQC8D9rLRE4dW_L0z2oNcBU8jtABVmL5XlYtTU15Uvd1NUbrH9hi6BA13fINZDRHpVQlP0DCe8J969vT87xyN1x_qfcLnOr5CvtvwcJHsWkRykm4XG-p9tMms Apr 12 10:56:47 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:56:47 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:56:47 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:56:47 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:56:47 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:56:47 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:56:47 user devstack@n-api.service[61853]: X-Project-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:56:47 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:47 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:56:47 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:56:47 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:56:47 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:47 user devstack@n-api.service[61853]: X-Tenant-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:56:47 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:47 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:56:47 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:56:47 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:56:47 user devstack@n-api.service[61853]: X-User-Id: 7ec47d3cdacb45e5a39509e76b546e34 Apr 12 10:56:47 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:56:47 user devstack@n-api.service[61853]: method: > Apr 12 10:56:47 user devstack@n-api.service[61853]: exception: Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 could not be found. Apr 12 10:56:47 user devstack@n-api.service[61853]: action_args: {'id': 'fcd57d3d-16cb-4b4e-8785-ae15027621a5'} Apr 12 10:56:47 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 could not be found. Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 could not be found. Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 could not be found. Apr 12 10:56:47 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:47 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b3c560dd-ee95-42ad-8228-853ca64e58bf tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Returning 404 to user: Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:56:47 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b3c560dd-ee95-42ad-8228-853ca64e58bf tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5" status: 404 len: 111 microversion: 2.1 time: 0.031081 Apr 12 10:56:47 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 307/937] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:56:47 2023] DELETE /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:56:47 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ebe9b5ea-d73c-4ea2-b175-d28ebb0edc52 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:56:47 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-ebe9b5ea-d73c-4ea2-b175-d28ebb0edc52 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:56:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ebe9b5ea-d73c-4ea2-b175-d28ebb0edc52 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ebe9b5ea-d73c-4ea2-b175-d28ebb0edc52 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ebe9b5ea-d73c-4ea2-b175-d28ebb0edc52 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ebe9b5ea-d73c-4ea2-b175-d28ebb0edc52 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ebe9b5ea-d73c-4ea2-b175-d28ebb0edc52 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:47 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ebe9b5ea-d73c-4ea2-b175-d28ebb0edc52 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:47 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-ebe9b5ea-d73c-4ea2-b175-d28ebb0edc52 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] HTTP exception thrown: Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 could not be found. Apr 12 10:56:47 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ebe9b5ea-d73c-4ea2-b175-d28ebb0edc52 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Request method failure captured: Apr 12 10:56:47 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5 HTTP/1.1 Apr 12 10:56:47 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:56:47 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:56:47 user devstack@n-api.service[61854]: Connection: close Apr 12 10:56:47 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:56:47 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:56:47 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:56:47 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:56:47 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:56:47 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNosjxmxcVjmUpCMLAxdRdLndUlKxh4MkCcirUvRtNoND63IGb1xoGABQC8D9rLRE4dW_L0z2oNcBU8jtABVmL5XlYtTU15Uvd1NUbrH9hi6BA13fINZDRHpVQlP0DCe8J969vT87xyN1x_qfcLnOr5CvtvwcJHsWkRykm4XG-p9tMms Apr 12 10:56:47 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:56:47 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:56:47 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:56:47 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:56:47 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:56:47 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:56:47 user devstack@n-api.service[61854]: X-Project-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:56:47 user devstack@n-api.service[61854]: X-Project-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:47 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:56:47 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:56:47 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:56:47 user devstack@n-api.service[61854]: X-Tenant: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:47 user devstack@n-api.service[61854]: X-Tenant-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:56:47 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:47 user devstack@n-api.service[61854]: X-User: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:56:47 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:56:47 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:56:47 user devstack@n-api.service[61854]: X-User-Id: 7ec47d3cdacb45e5a39509e76b546e34 Apr 12 10:56:47 user devstack@n-api.service[61854]: X-User-Name: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:56:47 user devstack@n-api.service[61854]: method: > Apr 12 10:56:47 user devstack@n-api.service[61854]: exception: Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 could not be found. Apr 12 10:56:47 user devstack@n-api.service[61854]: action_args: {'id': 'fcd57d3d-16cb-4b4e-8785-ae15027621a5'} Apr 12 10:56:47 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 could not be found. Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 could not be found. Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 could not be found. Apr 12 10:56:47 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:56:47 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ebe9b5ea-d73c-4ea2-b175-d28ebb0edc52 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Returning 404 to user: Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:56:47 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ebe9b5ea-d73c-4ea2-b175-d28ebb0edc52 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5" status: 404 len: 111 microversion: 2.1 time: 0.034911 Apr 12 10:56:47 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 319/938] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:56:47 2023] GET /compute/v2.1/servers/fcd57d3d-16cb-4b4e-8785-ae15027621a5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-2f1b856d-6439-4893-989a-bad1944174f6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-2f1b856d-6439-4893-989a-bad1944174f6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2f1b856d-6439-4893-989a-bad1944174f6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2f1b856d-6439-4893-989a-bad1944174f6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2f1b856d-6439-4893-989a-bad1944174f6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2f1b856d-6439-4893-989a-bad1944174f6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2f1b856d-6439-4893-989a-bad1944174f6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2f1b856d-6439-4893-989a-bad1944174f6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:50 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-2f1b856d-6439-4893-989a-bad1944174f6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] HTTP exception thrown: Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-2f1b856d-6439-4893-989a-bad1944174f6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Request method failure captured: Apr 12 10:56:50 user devstack@n-api.service[61852]: request: DELETE /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7 HTTP/1.1 Apr 12 10:56:50 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:56:50 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:56:50 user devstack@n-api.service[61852]: Connection: close Apr 12 10:56:50 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:56:50 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:56:50 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:56:50 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:56:50 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNosjxmxcVjmUpCMLAxdRdLndUlKxh4MkCcirUvRtNoND63IGb1xoGABQC8D9rLRE4dW_L0z2oNcBU8jtABVmL5XlYtTU15Uvd1NUbrH9hi6BA13fINZDRHpVQlP0DCe8J969vT87xyN1x_qfcLnOr5CvtvwcJHsWkRykm4XG-p9tMms Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Project-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Project-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Tenant: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Tenant-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:50 user devstack@n-api.service[61852]: X-User: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:56:50 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:56:50 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:56:50 user devstack@n-api.service[61852]: X-User-Id: 7ec47d3cdacb45e5a39509e76b546e34 Apr 12 10:56:50 user devstack@n-api.service[61852]: X-User-Name: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:56:50 user devstack@n-api.service[61852]: method: > Apr 12 10:56:50 user devstack@n-api.service[61852]: exception: Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61852]: action_args: {'id': '82ea43d4-f2b9-4665-b1c9-412367e2b4d7'} Apr 12 10:56:50 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-2f1b856d-6439-4893-989a-bad1944174f6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Returning 404 to user: Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:56:50 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-2f1b856d-6439-4893-989a-bad1944174f6 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7" status: 404 len: 111 microversion: 2.1 time: 0.039655 Apr 12 10:56:50 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 313/939] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:56:50 2023] DELETE /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8666cca6-801c-4814-8b13-d681557bb2de tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-8666cca6-801c-4814-8b13-d681557bb2de tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8666cca6-801c-4814-8b13-d681557bb2de tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8666cca6-801c-4814-8b13-d681557bb2de tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8666cca6-801c-4814-8b13-d681557bb2de tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8666cca6-801c-4814-8b13-d681557bb2de tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8666cca6-801c-4814-8b13-d681557bb2de tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8666cca6-801c-4814-8b13-d681557bb2de tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-8666cca6-801c-4814-8b13-d681557bb2de tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] HTTP exception thrown: Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8666cca6-801c-4814-8b13-d681557bb2de tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Request method failure captured: Apr 12 10:56:50 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7 HTTP/1.1 Apr 12 10:56:50 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:56:50 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:56:50 user devstack@n-api.service[61853]: Connection: close Apr 12 10:56:50 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:56:50 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:56:50 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:56:50 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:56:50 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNosjxmxcVjmUpCMLAxdRdLndUlKxh4MkCcirUvRtNoND63IGb1xoGABQC8D9rLRE4dW_L0z2oNcBU8jtABVmL5XlYtTU15Uvd1NUbrH9hi6BA13fINZDRHpVQlP0DCe8J969vT87xyN1x_qfcLnOr5CvtvwcJHsWkRykm4XG-p9tMms Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Project-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Tenant-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:50 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:56:50 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:56:50 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:56:50 user devstack@n-api.service[61853]: X-User-Id: 7ec47d3cdacb45e5a39509e76b546e34 Apr 12 10:56:50 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:56:50 user devstack@n-api.service[61853]: method: > Apr 12 10:56:50 user devstack@n-api.service[61853]: exception: Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61853]: action_args: {'id': '82ea43d4-f2b9-4665-b1c9-412367e2b4d7'} Apr 12 10:56:50 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8666cca6-801c-4814-8b13-d681557bb2de tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Returning 404 to user: Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:56:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8666cca6-801c-4814-8b13-d681557bb2de tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7" status: 404 len: 111 microversion: 2.1 time: 0.030792 Apr 12 10:56:50 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 308/940] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:56:50 2023] GET /compute/v2.1/servers/82ea43d4-f2b9-4665-b1c9-412367e2b4d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:56:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e030612f-7385-42e3-97ca-8851cc34f78f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:56:50 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e030612f-7385-42e3-97ca-8851cc34f78f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:56:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e030612f-7385-42e3-97ca-8851cc34f78f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e030612f-7385-42e3-97ca-8851cc34f78f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e030612f-7385-42e3-97ca-8851cc34f78f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e030612f-7385-42e3-97ca-8851cc34f78f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e030612f-7385-42e3-97ca-8851cc34f78f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:50 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e030612f-7385-42e3-97ca-8851cc34f78f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-e030612f-7385-42e3-97ca-8851cc34f78f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] HTTP exception thrown: Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e030612f-7385-42e3-97ca-8851cc34f78f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Request method failure captured: Apr 12 10:56:50 user devstack@n-api.service[61854]: request: DELETE /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44 HTTP/1.1 Apr 12 10:56:50 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:56:50 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:56:50 user devstack@n-api.service[61854]: Connection: close Apr 12 10:56:50 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:56:50 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:56:50 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:56:50 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:56:50 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:56:50 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNosjxmxcVjmUpCMLAxdRdLndUlKxh4MkCcirUvRtNoND63IGb1xoGABQC8D9rLRE4dW_L0z2oNcBU8jtABVmL5XlYtTU15Uvd1NUbrH9hi6BA13fINZDRHpVQlP0DCe8J969vT87xyN1x_qfcLnOr5CvtvwcJHsWkRykm4XG-p9tMms Apr 12 10:56:50 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:56:50 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:56:50 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:56:50 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:56:50 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:56:50 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:56:50 user devstack@n-api.service[61854]: X-Project-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:56:50 user devstack@n-api.service[61854]: X-Project-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:50 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:56:50 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:56:50 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:56:50 user devstack@n-api.service[61854]: X-Tenant: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:50 user devstack@n-api.service[61854]: X-Tenant-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:56:50 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:50 user devstack@n-api.service[61854]: X-User: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:56:50 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:56:50 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:56:50 user devstack@n-api.service[61854]: X-User-Id: 7ec47d3cdacb45e5a39509e76b546e34 Apr 12 10:56:50 user devstack@n-api.service[61854]: X-User-Name: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:56:50 user devstack@n-api.service[61854]: method: > Apr 12 10:56:50 user devstack@n-api.service[61854]: exception: Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61854]: action_args: {'id': '979fbc15-1dd0-46b8-a9c4-54be9d93da44'} Apr 12 10:56:50 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e030612f-7385-42e3-97ca-8851cc34f78f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Returning 404 to user: Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:56:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-e030612f-7385-42e3-97ca-8851cc34f78f tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44" status: 404 len: 111 microversion: 2.1 time: 0.033383 Apr 12 10:56:50 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 320/941] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:56:50 2023] DELETE /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-dcf1c1ee-315c-4fd7-bc6d-d20e1e6b1c43 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-dcf1c1ee-315c-4fd7-bc6d-d20e1e6b1c43 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-34710992-0f1f-46b9-9ae6-bb101e8add90 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-34710992-0f1f-46b9-9ae6-bb101e8add90 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-dcf1c1ee-315c-4fd7-bc6d-d20e1e6b1c43 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-dcf1c1ee-315c-4fd7-bc6d-d20e1e6b1c43 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-dcf1c1ee-315c-4fd7-bc6d-d20e1e6b1c43 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-dcf1c1ee-315c-4fd7-bc6d-d20e1e6b1c43 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-dcf1c1ee-315c-4fd7-bc6d-d20e1e6b1c43 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-dcf1c1ee-315c-4fd7-bc6d-d20e1e6b1c43 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-34710992-0f1f-46b9-9ae6-bb101e8add90 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-34710992-0f1f-46b9-9ae6-bb101e8add90 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-34710992-0f1f-46b9-9ae6-bb101e8add90 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-34710992-0f1f-46b9-9ae6-bb101e8add90 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-34710992-0f1f-46b9-9ae6-bb101e8add90 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-34710992-0f1f-46b9-9ae6-bb101e8add90 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:50 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-dcf1c1ee-315c-4fd7-bc6d-d20e1e6b1c43 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] HTTP exception thrown: Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-34710992-0f1f-46b9-9ae6-bb101e8add90 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] HTTP exception thrown: Instance cdc51c71-9d3b-4957-b912-0666c68b46fc could not be found. Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-dcf1c1ee-315c-4fd7-bc6d-d20e1e6b1c43 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Request method failure captured: Apr 12 10:56:50 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44 HTTP/1.1 Apr 12 10:56:50 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:56:50 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:56:50 user devstack@n-api.service[61852]: Connection: close Apr 12 10:56:50 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:56:50 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:56:50 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:56:50 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:56:50 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNosjxmxcVjmUpCMLAxdRdLndUlKxh4MkCcirUvRtNoND63IGb1xoGABQC8D9rLRE4dW_L0z2oNcBU8jtABVmL5XlYtTU15Uvd1NUbrH9hi6BA13fINZDRHpVQlP0DCe8J969vT87xyN1x_qfcLnOr5CvtvwcJHsWkRykm4XG-p9tMms Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Project-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Project-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Tenant: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Tenant-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:56:50 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:50 user devstack@n-api.service[61852]: X-User: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:56:50 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:56:50 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:56:50 user devstack@n-api.service[61852]: X-User-Id: 7ec47d3cdacb45e5a39509e76b546e34 Apr 12 10:56:50 user devstack@n-api.service[61852]: X-User-Name: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:56:50 user devstack@n-api.service[61852]: method: > Apr 12 10:56:50 user devstack@n-api.service[61852]: exception: Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61852]: action_args: {'id': '979fbc15-1dd0-46b8-a9c4-54be9d93da44'} Apr 12 10:56:50 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 could not be found. Apr 12 10:56:50 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-dcf1c1ee-315c-4fd7-bc6d-d20e1e6b1c43 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Returning 404 to user: Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-34710992-0f1f-46b9-9ae6-bb101e8add90 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Request method failure captured: Apr 12 10:56:50 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc HTTP/1.1 Apr 12 10:56:50 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:56:50 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:56:50 user devstack@n-api.service[61853]: Connection: close Apr 12 10:56:50 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:56:50 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:56:50 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:56:50 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:56:50 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNouwKaXaYhzw16o-0RmcYnB2vWXKp9V3tYvDadrCoi5enSg9cOgAwt8tJqWWBok9dqnjmTB2D-ZxTjJ_y3NnLll64p9kiYAUAwTGwJnB1xEAd70imb5w5FRbC8ttE3EjQl-W7mLs8xTx-jgIkSXAzVX82xeCBk1qBa6oFUWEA4HcNt0 Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Project-Id: b467fac451ee466fb93cec3d3aa3b408 Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Project-Name: tempest-TestMinimumBasicScenario-2095634766 Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b467fac451ee466fb93cec3d3aa3b408"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b467fac451ee466fb93cec3d3aa3b408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b467fac451ee466fb93cec3d3aa3b408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Tenant: tempest-TestMinimumBasicScenario-2095634766 Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Tenant-Id: b467fac451ee466fb93cec3d3aa3b408 Apr 12 10:56:50 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2095634766 Apr 12 10:56:50 user devstack@n-api.service[61853]: X-User: tempest-TestMinimumBasicScenario-2095634766-project-member Apr 12 10:56:50 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:56:50 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:56:50 user devstack@n-api.service[61853]: X-User-Id: a633ec4046a9467683cbfd2ebe59600f Apr 12 10:56:50 user devstack@n-api.service[61853]: X-User-Name: tempest-TestMinimumBasicScenario-2095634766-project-member Apr 12 10:56:50 user devstack@n-api.service[61853]: method: > Apr 12 10:56:50 user devstack@n-api.service[61853]: exception: Instance cdc51c71-9d3b-4957-b912-0666c68b46fc could not be found. Apr 12 10:56:50 user devstack@n-api.service[61853]: action_args: {'id': 'cdc51c71-9d3b-4957-b912-0666c68b46fc'} Apr 12 10:56:50 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdc51c71-9d3b-4957-b912-0666c68b46fc could not be found. Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdc51c71-9d3b-4957-b912-0666c68b46fc could not be found. Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdc51c71-9d3b-4957-b912-0666c68b46fc could not be found. Apr 12 10:56:50 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:50 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-dcf1c1ee-315c-4fd7-bc6d-d20e1e6b1c43 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44" status: 404 len: 111 microversion: 2.1 time: 0.032390 Apr 12 10:56:50 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-34710992-0f1f-46b9-9ae6-bb101e8add90 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Returning 404 to user: Instance cdc51c71-9d3b-4957-b912-0666c68b46fc could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:56:50 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 314/942] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:56:50 2023] GET /compute/v2.1/servers/979fbc15-1dd0-46b8-a9c4-54be9d93da44 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:56:50 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-34710992-0f1f-46b9-9ae6-bb101e8add90 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc" status: 404 len: 111 microversion: 2.1 time: 0.028635 Apr 12 10:56:50 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 309/943] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:56:50 2023] GET /compute/v2.1/servers/cdc51c71-9d3b-4957-b912-0666c68b46fc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:56:50 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-baa4c00b-69f1-4bb1-9f25-928dcc653b9f tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Calling method '.version_select at 0x7fabbf6495a0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:56:50 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-baa4c00b-69f1-4bb1-9f25-928dcc653b9f tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2078556363" status: 202 len: 0 microversion: 2.1 time: 0.032580 Apr 12 10:56:50 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 321/944] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 12 10:56:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2078556363 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:56:52 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-6d005874-5fb9-4cfb-89ab-9259aa5edd1d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:56:52 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-6d005874-5fb9-4cfb-89ab-9259aa5edd1d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:56:52 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6d005874-5fb9-4cfb-89ab-9259aa5edd1d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:52 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6d005874-5fb9-4cfb-89ab-9259aa5edd1d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:52 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6d005874-5fb9-4cfb-89ab-9259aa5edd1d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:52 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6d005874-5fb9-4cfb-89ab-9259aa5edd1d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:52 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6d005874-5fb9-4cfb-89ab-9259aa5edd1d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:52 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6d005874-5fb9-4cfb-89ab-9259aa5edd1d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:52 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-6d005874-5fb9-4cfb-89ab-9259aa5edd1d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] HTTP exception thrown: Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 could not be found. Apr 12 10:56:52 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-6d005874-5fb9-4cfb-89ab-9259aa5edd1d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Request method failure captured: Apr 12 10:56:52 user devstack@n-api.service[61852]: request: DELETE /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683 HTTP/1.1 Apr 12 10:56:52 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:56:52 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:56:52 user devstack@n-api.service[61852]: Connection: close Apr 12 10:56:52 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:56:52 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:56:52 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:56:52 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:56:52 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:56:52 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNosjxmxcVjmUpCMLAxdRdLndUlKxh4MkCcirUvRtNoND63IGb1xoGABQC8D9rLRE4dW_L0z2oNcBU8jtABVmL5XlYtTU15Uvd1NUbrH9hi6BA13fINZDRHpVQlP0DCe8J969vT87xyN1x_qfcLnOr5CvtvwcJHsWkRykm4XG-p9tMms Apr 12 10:56:52 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:56:52 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:56:52 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:56:52 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:56:52 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:56:52 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:56:52 user devstack@n-api.service[61852]: X-Project-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:56:52 user devstack@n-api.service[61852]: X-Project-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:52 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:56:52 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:56:52 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:56:52 user devstack@n-api.service[61852]: X-Tenant: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:52 user devstack@n-api.service[61852]: X-Tenant-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:56:52 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:52 user devstack@n-api.service[61852]: X-User: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:56:52 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:56:52 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:56:52 user devstack@n-api.service[61852]: X-User-Id: 7ec47d3cdacb45e5a39509e76b546e34 Apr 12 10:56:52 user devstack@n-api.service[61852]: X-User-Name: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:56:52 user devstack@n-api.service[61852]: method: > Apr 12 10:56:52 user devstack@n-api.service[61852]: exception: Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 could not be found. Apr 12 10:56:52 user devstack@n-api.service[61852]: action_args: {'id': '4b79f4d7-f34e-4971-8a6f-171c2d71d683'} Apr 12 10:56:52 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 could not be found. Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 could not be found. Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 could not be found. Apr 12 10:56:52 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:56:52 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-6d005874-5fb9-4cfb-89ab-9259aa5edd1d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Returning 404 to user: Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:56:52 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-6d005874-5fb9-4cfb-89ab-9259aa5edd1d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683" status: 404 len: 111 microversion: 2.1 time: 0.034477 Apr 12 10:56:52 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 315/945] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:56:52 2023] DELETE /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:56:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-891118d7-fb85-4ed5-b916-13dbb6f7f68d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:56:52 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-891118d7-fb85-4ed5-b916-13dbb6f7f68d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:56:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-891118d7-fb85-4ed5-b916-13dbb6f7f68d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-891118d7-fb85-4ed5-b916-13dbb6f7f68d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-891118d7-fb85-4ed5-b916-13dbb6f7f68d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-891118d7-fb85-4ed5-b916-13dbb6f7f68d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:56:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-891118d7-fb85-4ed5-b916-13dbb6f7f68d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:56:52 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-891118d7-fb85-4ed5-b916-13dbb6f7f68d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:56:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-891118d7-fb85-4ed5-b916-13dbb6f7f68d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] HTTP exception thrown: Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 could not be found. Apr 12 10:56:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-891118d7-fb85-4ed5-b916-13dbb6f7f68d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Request method failure captured: Apr 12 10:56:52 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683 HTTP/1.1 Apr 12 10:56:52 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:56:52 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:56:52 user devstack@n-api.service[61853]: Connection: close Apr 12 10:56:52 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:56:52 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:56:52 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:56:52 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:56:52 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:56:52 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNosjxmxcVjmUpCMLAxdRdLndUlKxh4MkCcirUvRtNoND63IGb1xoGABQC8D9rLRE4dW_L0z2oNcBU8jtABVmL5XlYtTU15Uvd1NUbrH9hi6BA13fINZDRHpVQlP0DCe8J969vT87xyN1x_qfcLnOr5CvtvwcJHsWkRykm4XG-p9tMms Apr 12 10:56:52 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:56:52 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:56:52 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:56:52 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:56:52 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:56:52 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:56:52 user devstack@n-api.service[61853]: X-Project-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:56:52 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:52 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:56:52 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:56:52 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c3cecbfbfd5f42dbb663367f6fbdf3b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:56:52 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:52 user devstack@n-api.service[61853]: X-Tenant-Id: c3cecbfbfd5f42dbb663367f6fbdf3b0 Apr 12 10:56:52 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249658876 Apr 12 10:56:52 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:56:52 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:56:52 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:56:52 user devstack@n-api.service[61853]: X-User-Id: 7ec47d3cdacb45e5a39509e76b546e34 Apr 12 10:56:52 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeNegativeTest-249658876-project-member Apr 12 10:56:52 user devstack@n-api.service[61853]: method: > Apr 12 10:56:52 user devstack@n-api.service[61853]: exception: Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 could not be found. Apr 12 10:56:52 user devstack@n-api.service[61853]: action_args: {'id': '4b79f4d7-f34e-4971-8a6f-171c2d71d683'} Apr 12 10:56:52 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 could not be found. Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 could not be found. Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 could not be found. Apr 12 10:56:52 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:56:52 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-891118d7-fb85-4ed5-b916-13dbb6f7f68d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Returning 404 to user: Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:56:52 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-891118d7-fb85-4ed5-b916-13dbb6f7f68d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683" status: 404 len: 111 microversion: 2.1 time: 0.030518 Apr 12 10:56:52 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 310/946] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:56:52 2023] GET /compute/v2.1/servers/4b79f4d7-f34e-4971-8a6f-171c2d71d683 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:57:02 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-19473d45-8f5f-465b-bb20-1d3cd72c3209 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:57:02 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-19473d45-8f5f-465b-bb20-1d3cd72c3209 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:57:02 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=18 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:02 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-19473d45-8f5f-465b-bb20-1d3cd72c3209 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-19473d45-8f5f-465b-bb20-1d3cd72c3209 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-19473d45-8f5f-465b-bb20-1d3cd72c3209 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-19473d45-8f5f-465b-bb20-1d3cd72c3209 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-19473d45-8f5f-465b-bb20-1d3cd72c3209 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:02 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-19473d45-8f5f-465b-bb20-1d3cd72c3209 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:02 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-19473d45-8f5f-465b-bb20-1d3cd72c3209 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.119899 Apr 12 10:57:02 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 322/947] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 10:57:02 2023] GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/os-interface => generated 282 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:57:03 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:03 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:03 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-843c53e2-d1d9-406b-ba74-d04a3bf1fd65 req-0450a45f-9071-42ec-ad98-68c51bf4b417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faa11b52-f2b6-45aa-937f-7468095ddb22", "tag": "46213af2-2a93-4502-9f35-eda3d5b9f7fc"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:57:03 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-843c53e2-d1d9-406b-ba74-d04a3bf1fd65 req-0450a45f-9071-42ec-ad98-68c51bf4b417 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:03 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-843c53e2-d1d9-406b-ba74-d04a3bf1fd65 req-0450a45f-9071-42ec-ad98-68c51bf4b417 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:03 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-843c53e2-d1d9-406b-ba74-d04a3bf1fd65 req-0450a45f-9071-42ec-ad98-68c51bf4b417 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:03 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-843c53e2-d1d9-406b-ba74-d04a3bf1fd65 req-0450a45f-9071-42ec-ad98-68c51bf4b417 service nova] Creating event network-changed:46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance faa11b52-f2b6-45aa-937f-7468095ddb22 on user Apr 12 10:57:03 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-843c53e2-d1d9-406b-ba74-d04a3bf1fd65 req-0450a45f-9071-42ec-ad98-68c51bf4b417 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201064 Apr 12 10:57:03 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 316/948] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:57:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:57:03 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:57:03 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:57:03 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=16 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:03 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=20 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:03 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:03 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'services' on Instance uuid faa11b52-f2b6-45aa-937f-7468095ddb22 {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:57:03 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/os-volume_attachments/e7d3b210-cbed-4d4a-8f47-f68cd0560193" status: 202 len: 0 microversion: 2.1 time: 0.181838 Apr 12 10:57:03 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 311/949] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 10:57:03 2023] DELETE /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/os-volume_attachments/e7d3b210-cbed-4d4a-8f47-f68cd0560193 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:57:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9c2a393f-011c-4e51-ab28-80bce58804cb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:57:03 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9c2a393f-011c-4e51-ab28-80bce58804cb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:57:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9c2a393f-011c-4e51-ab28-80bce58804cb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9c2a393f-011c-4e51-ab28-80bce58804cb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9c2a393f-011c-4e51-ab28-80bce58804cb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9c2a393f-011c-4e51-ab28-80bce58804cb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9c2a393f-011c-4e51-ab28-80bce58804cb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9c2a393f-011c-4e51-ab28-80bce58804cb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9c2a393f-011c-4e51-ab28-80bce58804cb tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060008 Apr 12 10:57:03 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 323/950] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:57:03 2023] GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:57:05 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-8bbe9b07-cb33-4f5b-a1f6-84693ac795ba req-7c248d46-d472-43bb-9220-0cd6d8aae5da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faa11b52-f2b6-45aa-937f-7468095ddb22", "tag": "46213af2-2a93-4502-9f35-eda3d5b9f7fc"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:57:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-8bbe9b07-cb33-4f5b-a1f6-84693ac795ba req-7c248d46-d472-43bb-9220-0cd6d8aae5da service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-8bbe9b07-cb33-4f5b-a1f6-84693ac795ba req-7c248d46-d472-43bb-9220-0cd6d8aae5da service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:05 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-8bbe9b07-cb33-4f5b-a1f6-84693ac795ba req-7c248d46-d472-43bb-9220-0cd6d8aae5da service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:05 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-8bbe9b07-cb33-4f5b-a1f6-84693ac795ba req-7c248d46-d472-43bb-9220-0cd6d8aae5da service nova] Creating event network-changed:46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance faa11b52-f2b6-45aa-937f-7468095ddb22 on user Apr 12 10:57:05 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-8bbe9b07-cb33-4f5b-a1f6-84693ac795ba req-7c248d46-d472-43bb-9220-0cd6d8aae5da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029401 Apr 12 10:57:05 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 317/951] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:57:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:57:14 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:14 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8decce4e-c7b1-4ca8-8bc7-168da2abba5d tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Action: 'create', calling method: .version_select at 0x7fabbf7b20e0>, body: {"keypair": {"name": "tempest-TestStampPattern-1731935486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaPyHRbcEnu+5+do5qHU+1eCHNMIdz7T58VS5Bcnzn0CUjwp6yQ03Ax3lmuZopCNO8dTcA62ZaKwisDZe976PqRTMzRs8Ozd6zeLPjLajysiE4TI0dVucPHR8mu4N+YIQ=="}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:57:14 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-8decce4e-c7b1-4ca8-8bc7-168da2abba5d tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Getting quotas for project 4a0f2b52a1a04769803c3a44a924ff00. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:57:14 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-8decce4e-c7b1-4ca8-8bc7-168da2abba5d tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Getting quotas for user aed741675f5944f1882c097c411437f6 and project 4a0f2b52a1a04769803c3a44a924ff00. Resources: {'key_pairs'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:57:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8decce4e-c7b1-4ca8-8bc7-168da2abba5d tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.232304 Apr 12 10:57:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 312/952] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 10:57:14 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:57:17 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1949196284", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1731935486", "security_groups": [{"name": "tempest-secgroup-smoke-1233307456"}], "networks": [{"uuid": "b1da98cc-b18c-477c-9e03-df8190b944d1"}]}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:57:17 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:17 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=10 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:17 user devstack@n-api.service[61854]: DEBUG nova.network.neutron [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] validate_networks() for [('b1da98cc-b18c-477c-9e03-df8190b944d1', None, None, None, None, None)] {{(pid=61854) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:57:18 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Flavor limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:57:18 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Image limits 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:57:18 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Flavor pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:57:18 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Image pref 0:0:0 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:57:18 user devstack@n-api.service[61854]: DEBUG nova.virt.hardware [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:57:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:18 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Getting quotas for project 4a0f2b52a1a04769803c3a44a924ff00. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:57:18 user devstack@n-api.service[61854]: DEBUG nova.quota [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Getting quotas for user aed741675f5944f1882c097c411437f6 and project 4a0f2b52a1a04769803c3a44a924ff00. Resources: {'cores', 'instances', 'ram'} {{(pid=61854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:57:18 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Going to run 1 instances... {{(pid=61854) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:57:18 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:57:18 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.640408 Apr 12 10:57:18 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 324/953] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:57:17 2023] POST /compute/v2.1/servers => generated 404 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:57:18 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:18 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:18 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-1cda5d32-6f8d-47d6-8c8c-2b1e1fd60bc1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:57:18 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-1cda5d32-6f8d-47d6-8c8c-2b1e1fd60bc1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:57:18 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-1cda5d32-6f8d-47d6-8c8c-2b1e1fd60bc1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed741675f5944f1882c097c411437f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0f2b52a1a04769803c3a44a924ff00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:57:18 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-1cda5d32-6f8d-47d6-8c8c-2b1e1fd60bc1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6" status: 200 len: 1237 microversion: 2.1 time: 0.088552 Apr 12 10:57:18 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 318/954] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:57:18 2023] GET /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6 => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:57:19 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-96eda391-7010-4108-afeb-4740e14c3c5e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:57:19 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-96eda391-7010-4108-afeb-4740e14c3c5e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:57:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-96eda391-7010-4108-afeb-4740e14c3c5e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-96eda391-7010-4108-afeb-4740e14c3c5e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-96eda391-7010-4108-afeb-4740e14c3c5e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-96eda391-7010-4108-afeb-4740e14c3c5e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-96eda391-7010-4108-afeb-4740e14c3c5e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-96eda391-7010-4108-afeb-4740e14c3c5e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:20 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-96eda391-7010-4108-afeb-4740e14c3c5e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:57:20 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-96eda391-7010-4108-afeb-4740e14c3c5e tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136" status: 200 len: 1547 microversion: 2.1 time: 0.318572 Apr 12 10:57:20 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 313/955] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:57:19 2023] GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136 => generated 1547 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:57:20 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b12fe0ab-e860-4b15-bb24-edea38d85dd4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:57:20 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-b12fe0ab-e860-4b15-bb24-edea38d85dd4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:57:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b12fe0ab-e860-4b15-bb24-edea38d85dd4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b12fe0ab-e860-4b15-bb24-edea38d85dd4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b12fe0ab-e860-4b15-bb24-edea38d85dd4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b12fe0ab-e860-4b15-bb24-edea38d85dd4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b12fe0ab-e860-4b15-bb24-edea38d85dd4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b12fe0ab-e860-4b15-bb24-edea38d85dd4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b12fe0ab-e860-4b15-bb24-edea38d85dd4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136/action" status: 200 len: 28411 microversion: 2.1 time: 0.469756 Apr 12 10:57:20 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 325/956] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:57:20 2023] POST /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136/action => generated 28411 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 10:57:20 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-5dd9f324-371f-4a0d-be7c-2b2c9999876c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:57:20 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-5dd9f324-371f-4a0d-be7c-2b2c9999876c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:57:20 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5dd9f324-371f-4a0d-be7c-2b2c9999876c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:20 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5dd9f324-371f-4a0d-be7c-2b2c9999876c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:20 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5dd9f324-371f-4a0d-be7c-2b2c9999876c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:20 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5dd9f324-371f-4a0d-be7c-2b2c9999876c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:20 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5dd9f324-371f-4a0d-be7c-2b2c9999876c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:20 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5dd9f324-371f-4a0d-be7c-2b2c9999876c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:20 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-5dd9f324-371f-4a0d-be7c-2b2c9999876c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:57:20 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-5dd9f324-371f-4a0d-be7c-2b2c9999876c tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" status: 200 len: 1539 microversion: 2.1 time: 0.205083 Apr 12 10:57:20 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 319/957] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:57:20 2023] GET /compute/v2.1/servers/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 => generated 1539 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:57:21 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-33c7e505-f32c-459d-a931-01def868d567 req-5331fe70-07da-4412-840b-e08225a8dba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faf5e629-c914-43a1-bd73-ce4adfafe9d6", "tag": "f43a5f64-a4b2-481b-9785-6a556a795d0a"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:57:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-33c7e505-f32c-459d-a931-01def868d567 req-5331fe70-07da-4412-840b-e08225a8dba6 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-33c7e505-f32c-459d-a931-01def868d567 req-5331fe70-07da-4412-840b-e08225a8dba6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-33c7e505-f32c-459d-a931-01def868d567 req-5331fe70-07da-4412-840b-e08225a8dba6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-33c7e505-f32c-459d-a931-01def868d567 req-5331fe70-07da-4412-840b-e08225a8dba6 service nova] Creating event network-changed:f43a5f64-a4b2-481b-9785-6a556a795d0a for instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 on user Apr 12 10:57:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-33c7e505-f32c-459d-a931-01def868d567 req-5331fe70-07da-4412-840b-e08225a8dba6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035352 Apr 12 10:57:21 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 314/958] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:57:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:57:23 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-10c702c1-0dab-41c5-9a50-522ca9016f42 req-083d5ca0-f6a5-4727-8b98-ed79afe74985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faf5e629-c914-43a1-bd73-ce4adfafe9d6", "name": "network-vif-plugged", "status": "completed", "tag": "f43a5f64-a4b2-481b-9785-6a556a795d0a"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:57:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-10c702c1-0dab-41c5-9a50-522ca9016f42 req-083d5ca0-f6a5-4727-8b98-ed79afe74985 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-10c702c1-0dab-41c5-9a50-522ca9016f42 req-083d5ca0-f6a5-4727-8b98-ed79afe74985 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-10c702c1-0dab-41c5-9a50-522ca9016f42 req-083d5ca0-f6a5-4727-8b98-ed79afe74985 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-10c702c1-0dab-41c5-9a50-522ca9016f42 req-083d5ca0-f6a5-4727-8b98-ed79afe74985 service nova] Creating event network-vif-plugged:f43a5f64-a4b2-481b-9785-6a556a795d0a for instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 on user Apr 12 10:57:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-10c702c1-0dab-41c5-9a50-522ca9016f42 req-083d5ca0-f6a5-4727-8b98-ed79afe74985 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043812 Apr 12 10:57:23 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 326/959] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:57:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:57:25 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-d9ca2a76-25fe-4acc-bbd4-7d3c3631024f req-4e8d6114-9340-4800-9284-1b43f7916caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faf5e629-c914-43a1-bd73-ce4adfafe9d6", "name": "network-vif-plugged", "status": "completed", "tag": "f43a5f64-a4b2-481b-9785-6a556a795d0a"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:57:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d9ca2a76-25fe-4acc-bbd4-7d3c3631024f req-4e8d6114-9340-4800-9284-1b43f7916caa service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d9ca2a76-25fe-4acc-bbd4-7d3c3631024f req-4e8d6114-9340-4800-9284-1b43f7916caa service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d9ca2a76-25fe-4acc-bbd4-7d3c3631024f req-4e8d6114-9340-4800-9284-1b43f7916caa service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-d9ca2a76-25fe-4acc-bbd4-7d3c3631024f req-4e8d6114-9340-4800-9284-1b43f7916caa service nova] Creating event network-vif-plugged:f43a5f64-a4b2-481b-9785-6a556a795d0a for instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 on user Apr 12 10:57:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-d9ca2a76-25fe-4acc-bbd4-7d3c3631024f req-4e8d6114-9340-4800-9284-1b43f7916caa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062177 Apr 12 10:57:25 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 320/960] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:57:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:57:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-892630e3-0919-4137-9711-377ff4a0562c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:57:30 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-892630e3-0919-4137-9711-377ff4a0562c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:57:30 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-892630e3-0919-4137-9711-377ff4a0562c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-892630e3-0919-4137-9711-377ff4a0562c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-892630e3-0919-4137-9711-377ff4a0562c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-892630e3-0919-4137-9711-377ff4a0562c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-892630e3-0919-4137-9711-377ff4a0562c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-892630e3-0919-4137-9711-377ff4a0562c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:30 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-892630e3-0919-4137-9711-377ff4a0562c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6576467073e41e9b497097d5a8dfd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9878bfe34ceb4a6695b253ad161c4f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:57:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-892630e3-0919-4137-9711-377ff4a0562c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644" status: 200 len: 1702 microversion: 2.1 time: 0.172857 Apr 12 10:57:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 315/961] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:57:30 2023] GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644 => generated 1702 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:57:32 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:32 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:32 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ff27e218-f388-47b5-88f2-a4c00f08ce8e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:57:32 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-ff27e218-f388-47b5-88f2-a4c00f08ce8e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:57:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ff27e218-f388-47b5-88f2-a4c00f08ce8e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ff27e218-f388-47b5-88f2-a4c00f08ce8e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ff27e218-f388-47b5-88f2-a4c00f08ce8e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ff27e218-f388-47b5-88f2-a4c00f08ce8e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ff27e218-f388-47b5-88f2-a4c00f08ce8e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:32 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ff27e218-f388-47b5-88f2-a4c00f08ce8e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:32 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-ff27e218-f388-47b5-88f2-a4c00f08ce8e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HTTP exception thrown: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. Apr 12 10:57:32 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ff27e218-f388-47b5-88f2-a4c00f08ce8e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Request method failure captured: Apr 12 10:57:32 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de HTTP/1.1 Apr 12 10:57:32 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:57:32 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:57:32 user devstack@n-api.service[61854]: Connection: close Apr 12 10:57:32 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:57:32 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:57:32 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:57:32 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:57:32 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:57:32 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNovxs2Yantu_ODChXuBI9nxlNd7q64TcAdmUtsdyhrTlt2TPQv6HrTQUW80fTGqaBlerbQwCAm7dWKzvWOOjt7pPApBNdqpqIJVLzbKcuxIuQw915erA4Eg80ETTsBe76KDhlSBBUJHZF_I_Yg-BxJFHiVfAbJBMyp551Ap5yqYIsVQ Apr 12 10:57:32 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:57:32 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:57:32 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:57:32 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:57:32 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:57:32 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:57:32 user devstack@n-api.service[61854]: X-Project-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:57:32 user devstack@n-api.service[61854]: X-Project-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:57:32 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:57:32 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:57:32 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:57:32 user devstack@n-api.service[61854]: X-Tenant: tempest-TestVolumeBootPattern-638607559 Apr 12 10:57:32 user devstack@n-api.service[61854]: X-Tenant-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 10:57:32 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 10:57:32 user devstack@n-api.service[61854]: X-User: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:57:32 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:57:32 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:57:32 user devstack@n-api.service[61854]: X-User-Id: b914d7ca786f455baf120f98816abffd Apr 12 10:57:32 user devstack@n-api.service[61854]: X-User-Name: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 10:57:32 user devstack@n-api.service[61854]: method: > Apr 12 10:57:32 user devstack@n-api.service[61854]: exception: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. Apr 12 10:57:32 user devstack@n-api.service[61854]: action_args: {'id': '95469ca9-8f8d-4755-8a00-4e2f5689f3de'} Apr 12 10:57:32 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. Apr 12 10:57:32 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:57:32 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ff27e218-f388-47b5-88f2-a4c00f08ce8e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Returning 404 to user: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:57:32 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ff27e218-f388-47b5-88f2-a4c00f08ce8e tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de" status: 404 len: 111 microversion: 2.1 time: 0.041357 Apr 12 10:57:32 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 327/962] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:57:32 2023] GET /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:57:32 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:32 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-153844544", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-162796269", "security_groups": [{"name": "tempest-secgroup-smoke-188917005"}], "block_device_mapping_v2": [{"uuid": "27a37b7e-8277-4e8d-8d37-9fbc82af9ff9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3ecf6069-4851-431c-a1c3-13e94566fa0b"}]}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:57:32 user devstack@n-api.service[61852]: DEBUG nova.network.neutron [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] validate_networks() for [('3ecf6069-4851-431c-a1c3-13e94566fa0b', None, None, None, None, None)] {{(pid=61852) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:57:33 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:57:33 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:57:33 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:57:33 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:57:33 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:57:33 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:33 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:33 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:33 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:33 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:33 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:33 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting quotas for project a67f3d23b8f74a9496d445c7fc75717e. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:57:33 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting quotas for user b914d7ca786f455baf120f98816abffd and project a67f3d23b8f74a9496d445c7fc75717e. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:57:33 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Going to run 1 instances... {{(pid=61852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:57:33 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='27a37b7e-8277-4e8d-8d37-9fbc82af9ff9',volume_size=None,volume_type=None)] {{(pid=61852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:57:33 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.887461 Apr 12 10:57:33 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 321/963] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:57:32 2023] POST /compute/v2.1/servers => generated 403 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:57:33 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4182be4d-440b-4e3c-a45d-c620823d21c6 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:57:33 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-4182be4d-440b-4e3c-a45d-c620823d21c6 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:57:33 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-4182be4d-440b-4e3c-a45d-c620823d21c6 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:57:33 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-4182be4d-440b-4e3c-a45d-c620823d21c6 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" status: 200 len: 1088 microversion: 2.1 time: 0.114067 Apr 12 10:57:33 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 316/964] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:57:33 2023] GET /compute/v2.1/servers/e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 => generated 1088 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 10:57:36 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-08967048-5157-47d4-af05-4c7d4418c020 req-c682e50c-3053-46a7-b64f-b79e0ac044c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280", "tag": "f0316e9d-800d-42f6-9078-eafa6da69f0d"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:57:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-08967048-5157-47d4-af05-4c7d4418c020 req-c682e50c-3053-46a7-b64f-b79e0ac044c8 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-08967048-5157-47d4-af05-4c7d4418c020 req-c682e50c-3053-46a7-b64f-b79e0ac044c8 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:36 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-08967048-5157-47d4-af05-4c7d4418c020 req-c682e50c-3053-46a7-b64f-b79e0ac044c8 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-08967048-5157-47d4-af05-4c7d4418c020 req-c682e50c-3053-46a7-b64f-b79e0ac044c8 service nova] Creating event network-changed:f0316e9d-800d-42f6-9078-eafa6da69f0d for instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 on user Apr 12 10:57:36 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-08967048-5157-47d4-af05-4c7d4418c020 req-c682e50c-3053-46a7-b64f-b79e0ac044c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031733 Apr 12 10:57:36 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 328/965] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:57:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:57:42 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-15e40d14-832e-4542-a221-fd273a6c637d req-b285a1ef-a8b3-4a59-b9d3-90a00b5c3914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280", "name": "network-vif-plugged", "status": "completed", "tag": "f0316e9d-800d-42f6-9078-eafa6da69f0d"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:57:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-15e40d14-832e-4542-a221-fd273a6c637d req-b285a1ef-a8b3-4a59-b9d3-90a00b5c3914 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-15e40d14-832e-4542-a221-fd273a6c637d req-b285a1ef-a8b3-4a59-b9d3-90a00b5c3914 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:42 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-15e40d14-832e-4542-a221-fd273a6c637d req-b285a1ef-a8b3-4a59-b9d3-90a00b5c3914 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:42 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-15e40d14-832e-4542-a221-fd273a6c637d req-b285a1ef-a8b3-4a59-b9d3-90a00b5c3914 service nova] Creating event network-vif-plugged:f0316e9d-800d-42f6-9078-eafa6da69f0d for instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 on user Apr 12 10:57:42 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-15e40d14-832e-4542-a221-fd273a6c637d req-b285a1ef-a8b3-4a59-b9d3-90a00b5c3914 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038014 Apr 12 10:57:42 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 322/966] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:57:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:57:44 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=14 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:44 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:44 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:44 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-9be14547-0059-43dd-b522-d1171bffc376 req-ecb7baa8-d92a-4e02-b94a-826d838b5533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280", "name": "network-vif-plugged", "status": "completed", "tag": "f0316e9d-800d-42f6-9078-eafa6da69f0d"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:57:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9be14547-0059-43dd-b522-d1171bffc376 req-ecb7baa8-d92a-4e02-b94a-826d838b5533 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9be14547-0059-43dd-b522-d1171bffc376 req-ecb7baa8-d92a-4e02-b94a-826d838b5533 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:44 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9be14547-0059-43dd-b522-d1171bffc376 req-ecb7baa8-d92a-4e02-b94a-826d838b5533 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-9be14547-0059-43dd-b522-d1171bffc376 req-ecb7baa8-d92a-4e02-b94a-826d838b5533 service nova] Creating event network-vif-plugged:f0316e9d-800d-42f6-9078-eafa6da69f0d for instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 on user Apr 12 10:57:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-9be14547-0059-43dd-b522-d1171bffc376 req-ecb7baa8-d92a-4e02-b94a-826d838b5533 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093672 Apr 12 10:57:44 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 317/967] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:57:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:57:53 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:53 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=12 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:53 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e4c91120-d3b0-452e-8d0e-a968bfcfb7a5 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:57:53 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e4c91120-d3b0-452e-8d0e-a968bfcfb7a5 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:57:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e4c91120-d3b0-452e-8d0e-a968bfcfb7a5 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e4c91120-d3b0-452e-8d0e-a968bfcfb7a5 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e4c91120-d3b0-452e-8d0e-a968bfcfb7a5 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e4c91120-d3b0-452e-8d0e-a968bfcfb7a5 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e4c91120-d3b0-452e-8d0e-a968bfcfb7a5 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:53 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e4c91120-d3b0-452e-8d0e-a968bfcfb7a5 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:53 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-e4c91120-d3b0-452e-8d0e-a968bfcfb7a5 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052278 Apr 12 10:57:53 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 329/968] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:57:53 2023] GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 10:57:53 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:53 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:53 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:53 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=12 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:57:53 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:57:53 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:57:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:53 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:53 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:57:53 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22" status: 204 len: 0 microversion: 2.1 time: 0.121145 Apr 12 10:57:53 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 323/969] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:57:53 2023] DELETE /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:57:53 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-50293fb9-741c-4687-ac2b-116ad07e87f8 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:57:53 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-50293fb9-741c-4687-ac2b-116ad07e87f8 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:57:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-50293fb9-741c-4687-ac2b-116ad07e87f8 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-50293fb9-741c-4687-ac2b-116ad07e87f8 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-50293fb9-741c-4687-ac2b-116ad07e87f8 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-50293fb9-741c-4687-ac2b-116ad07e87f8 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-50293fb9-741c-4687-ac2b-116ad07e87f8 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:53 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-50293fb9-741c-4687-ac2b-116ad07e87f8 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:54 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-50293fb9-741c-4687-ac2b-116ad07e87f8 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:57:54 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-50293fb9-741c-4687-ac2b-116ad07e87f8 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22" status: 200 len: 1679 microversion: 2.1 time: 0.210193 Apr 12 10:57:54 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 318/970] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:57:53 2023] GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22 => generated 1679 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:57:54 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-6ba56424-44a6-4a4e-8a02-807def830dd3 req-cb0298ef-4547-4c4e-a8e3-9e1a6fb3b71b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa11b52-f2b6-45aa-937f-7468095ddb22", "name": "network-vif-unplugged", "status": "completed", "tag": "46213af2-2a93-4502-9f35-eda3d5b9f7fc"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:57:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-6ba56424-44a6-4a4e-8a02-807def830dd3 req-cb0298ef-4547-4c4e-a8e3-9e1a6fb3b71b service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-6ba56424-44a6-4a4e-8a02-807def830dd3 req-cb0298ef-4547-4c4e-a8e3-9e1a6fb3b71b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:54 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-6ba56424-44a6-4a4e-8a02-807def830dd3 req-cb0298ef-4547-4c4e-a8e3-9e1a6fb3b71b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-6ba56424-44a6-4a4e-8a02-807def830dd3 req-cb0298ef-4547-4c4e-a8e3-9e1a6fb3b71b service nova] Creating event network-vif-unplugged:46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance faa11b52-f2b6-45aa-937f-7468095ddb22 on user Apr 12 10:57:54 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-6ba56424-44a6-4a4e-8a02-807def830dd3 req-cb0298ef-4547-4c4e-a8e3-9e1a6fb3b71b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029897 Apr 12 10:57:54 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 330/971] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:57:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:57:55 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-6966339e-8968-4c0b-8828-a43b11c1d6f9 req-3ef76f90-5ef6-4b9c-b992-9447e5a4a4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa11b52-f2b6-45aa-937f-7468095ddb22", "name": "network-vif-deleted", "tag": "46213af2-2a93-4502-9f35-eda3d5b9f7fc"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:57:55 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-6966339e-8968-4c0b-8828-a43b11c1d6f9 req-3ef76f90-5ef6-4b9c-b992-9447e5a4a4da service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:55 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-6966339e-8968-4c0b-8828-a43b11c1d6f9 req-3ef76f90-5ef6-4b9c-b992-9447e5a4a4da service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:55 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-6966339e-8968-4c0b-8828-a43b11c1d6f9 req-3ef76f90-5ef6-4b9c-b992-9447e5a4a4da service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:55 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-6966339e-8968-4c0b-8828-a43b11c1d6f9 req-3ef76f90-5ef6-4b9c-b992-9447e5a4a4da service nova] Creating event network-vif-deleted:46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance faa11b52-f2b6-45aa-937f-7468095ddb22 on user Apr 12 10:57:55 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-6966339e-8968-4c0b-8828-a43b11c1d6f9 req-3ef76f90-5ef6-4b9c-b992-9447e5a4a4da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032525 Apr 12 10:57:55 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 324/972] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:57:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:57:56 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-2c7814b7-7b1a-4dab-a337-198621404b33 req-28113b81-3ccd-424c-9230-873c2d28718b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa11b52-f2b6-45aa-937f-7468095ddb22", "name": "network-vif-plugged", "status": "completed", "tag": "46213af2-2a93-4502-9f35-eda3d5b9f7fc"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:57:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-2c7814b7-7b1a-4dab-a337-198621404b33 req-28113b81-3ccd-424c-9230-873c2d28718b service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:57:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-2c7814b7-7b1a-4dab-a337-198621404b33 req-28113b81-3ccd-424c-9230-873c2d28718b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:57:56 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-2c7814b7-7b1a-4dab-a337-198621404b33 req-28113b81-3ccd-424c-9230-873c2d28718b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:57:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-2c7814b7-7b1a-4dab-a337-198621404b33 req-28113b81-3ccd-424c-9230-873c2d28718b service nova] Creating event network-vif-plugged:46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance faa11b52-f2b6-45aa-937f-7468095ddb22 on user Apr 12 10:57:56 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-2c7814b7-7b1a-4dab-a337-198621404b33 req-28113b81-3ccd-424c-9230-873c2d28718b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037478 Apr 12 10:57:56 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 319/973] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:57:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:58:08 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:58:08 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=8 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:58:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f5199869-ade7-4790-800b-0f0dc304f5a0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:58:08 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f5199869-ade7-4790-800b-0f0dc304f5a0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:58:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f5199869-ade7-4790-800b-0f0dc304f5a0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f5199869-ade7-4790-800b-0f0dc304f5a0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f5199869-ade7-4790-800b-0f0dc304f5a0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f5199869-ade7-4790-800b-0f0dc304f5a0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f5199869-ade7-4790-800b-0f0dc304f5a0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f5199869-ade7-4790-800b-0f0dc304f5a0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:08 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-f5199869-ade7-4790-800b-0f0dc304f5a0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed741675f5944f1882c097c411437f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0f2b52a1a04769803c3a44a924ff00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:58:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f5199869-ade7-4790-800b-0f0dc304f5a0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6" status: 200 len: 1540 microversion: 2.1 time: 0.166981 Apr 12 10:58:08 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 331/974] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:58:08 2023] GET /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6 => generated 1540 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 10:58:19 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:58:19 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:58:19 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-14224898-031e-4649-90a0-4f67cf396552 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Action: 'create', calling method: .version_select at 0x7fabbf86f6d0>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1583885298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwO2yVN0u4XlGH0M6pDTSgYUXsaaLN0zeC0aV1LGDSj49QfeGZM69qUPGAnK7OxkSIagJ6xwwO/GKxzZp+RcnTTv3Y+zrrV1Kux6mF8yggHb85/hY7NtDL0hDRxifjmA=="}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:58:19 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-14224898-031e-4649-90a0-4f67cf396552 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Getting quotas for project 7541fb4f462b438dbef4ffe9be4725b5. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:58:19 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-14224898-031e-4649-90a0-4f67cf396552 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Getting quotas for user 325a0abaf7b6485ca97e2d2af2bc9778 and project 7541fb4f462b438dbef4ffe9be4725b5. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:58:19 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-14224898-031e-4649-90a0-4f67cf396552 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.256117 Apr 12 10:58:19 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 325/975] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 10:58:19 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:58:21 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:58:21 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:58:21 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:58:21 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=10 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:58:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:21 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:58:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136" status: 204 len: 0 microversion: 2.1 time: 0.131633 Apr 12 10:58:21 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 320/976] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:58:21 2023] DELETE /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:58:21 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0187d724-1d7c-4593-8bfc-16ebe63d3702 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:58:21 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-0187d724-1d7c-4593-8bfc-16ebe63d3702 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:58:21 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:58:21 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:58:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0187d724-1d7c-4593-8bfc-16ebe63d3702 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0187d724-1d7c-4593-8bfc-16ebe63d3702 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0187d724-1d7c-4593-8bfc-16ebe63d3702 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0187d724-1d7c-4593-8bfc-16ebe63d3702 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0187d724-1d7c-4593-8bfc-16ebe63d3702 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0187d724-1d7c-4593-8bfc-16ebe63d3702 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:21 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-889710473", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1583885298", "security_groups": [{"name": "tempest-secgroup-smoke-756012916"}], "networks": [{"uuid": "5335fcd4-c9ce-4288-a2e9-4e9a1da25000"}]}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:58:21 user devstack@n-api.service[61852]: DEBUG nova.network.neutron [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] validate_networks() for [('5335fcd4-c9ce-4288-a2e9-4e9a1da25000', None, None, None, None, None)] {{(pid=61852) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:58:21 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-0187d724-1d7c-4593-8bfc-16ebe63d3702 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:58:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-0187d724-1d7c-4593-8bfc-16ebe63d3702 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136" status: 200 len: 1553 microversion: 2.1 time: 0.172794 Apr 12 10:58:21 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 332/977] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:58:21 2023] GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:58:21 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-9a51624e-5718-4307-a85b-e5157d34e26a req-9578570e-b5ce-42da-aa1f-b837a1a90885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb22a78-94df-49fb-918c-32856e1b5136", "name": "network-vif-unplugged", "status": "completed", "tag": "225efc65-26fe-4d54-93aa-35298d6ddd3f"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:58:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9a51624e-5718-4307-a85b-e5157d34e26a req-9578570e-b5ce-42da-aa1f-b837a1a90885 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9a51624e-5718-4307-a85b-e5157d34e26a req-9578570e-b5ce-42da-aa1f-b837a1a90885 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-9a51624e-5718-4307-a85b-e5157d34e26a req-9578570e-b5ce-42da-aa1f-b837a1a90885 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-9a51624e-5718-4307-a85b-e5157d34e26a req-9578570e-b5ce-42da-aa1f-b837a1a90885 service nova] Creating event network-vif-unplugged:225efc65-26fe-4d54-93aa-35298d6ddd3f for instance 0cb22a78-94df-49fb-918c-32856e1b5136 on user Apr 12 10:58:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-9a51624e-5718-4307-a85b-e5157d34e26a req-9578570e-b5ce-42da-aa1f-b837a1a90885 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054131 Apr 12 10:58:21 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 321/978] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:58:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:58:21 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Flavor limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:58:21 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Image limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:58:21 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Flavor pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:58:21 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Image pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:58:21 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:58:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:21 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Getting quotas for project 7541fb4f462b438dbef4ffe9be4725b5. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:58:21 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Getting quotas for user 325a0abaf7b6485ca97e2d2af2bc9778 and project 7541fb4f462b438dbef4ffe9be4725b5. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:58:22 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Going to run 1 instances... {{(pid=61852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:58:22 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:58:22 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.879626 Apr 12 10:58:22 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 326/979] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:58:21 2023] POST /compute/v2.1/servers => generated 403 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:58:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a64d6271-3324-435e-a318-1ffa05ad333f tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:58:22 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a64d6271-3324-435e-a318-1ffa05ad333f tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:58:22 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-a64d6271-3324-435e-a318-1ffa05ad333f tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325a0abaf7b6485ca97e2d2af2bc9778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7541fb4f462b438dbef4ffe9be4725b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:58:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a64d6271-3324-435e-a318-1ffa05ad333f tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87" status: 200 len: 1256 microversion: 2.1 time: 0.072978 Apr 12 10:58:22 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 333/980] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:58:22 2023] GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87 => generated 1256 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:58:23 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-b3715a98-9e14-4354-a16a-88c2d8c60fe6 req-09425434-6354-46d9-9e55-fa34c9b0fcc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb22a78-94df-49fb-918c-32856e1b5136", "name": "network-vif-deleted", "tag": "225efc65-26fe-4d54-93aa-35298d6ddd3f"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:58:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b3715a98-9e14-4354-a16a-88c2d8c60fe6 req-09425434-6354-46d9-9e55-fa34c9b0fcc3 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b3715a98-9e14-4354-a16a-88c2d8c60fe6 req-09425434-6354-46d9-9e55-fa34c9b0fcc3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b3715a98-9e14-4354-a16a-88c2d8c60fe6 req-09425434-6354-46d9-9e55-fa34c9b0fcc3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-b3715a98-9e14-4354-a16a-88c2d8c60fe6 req-09425434-6354-46d9-9e55-fa34c9b0fcc3 service nova] Creating event network-vif-deleted:225efc65-26fe-4d54-93aa-35298d6ddd3f for instance 0cb22a78-94df-49fb-918c-32856e1b5136 on user Apr 12 10:58:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-b3715a98-9e14-4354-a16a-88c2d8c60fe6 req-09425434-6354-46d9-9e55-fa34c9b0fcc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031003 Apr 12 10:58:23 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 322/981] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:58:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:58:23 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-79d9bb24-b1d5-4223-bd93-9382f8c97876 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:58:23 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-79d9bb24-b1d5-4223-bd93-9382f8c97876 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:58:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-79d9bb24-b1d5-4223-bd93-9382f8c97876 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-79d9bb24-b1d5-4223-bd93-9382f8c97876 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-79d9bb24-b1d5-4223-bd93-9382f8c97876 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-79d9bb24-b1d5-4223-bd93-9382f8c97876 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-79d9bb24-b1d5-4223-bd93-9382f8c97876 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-79d9bb24-b1d5-4223-bd93-9382f8c97876 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:23 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-79d9bb24-b1d5-4223-bd93-9382f8c97876 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:58:23 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-79d9bb24-b1d5-4223-bd93-9382f8c97876 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" status: 200 len: 1440 microversion: 2.1 time: 0.266030 Apr 12 10:58:23 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 327/982] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:58:23 2023] GET /compute/v2.1/servers/e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 => generated 1440 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:58:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-d248f754-c282-47c0-9b7f-6f7a3106e421 req-a06ecb19-064a-4490-a75c-b7e643c513b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb22a78-94df-49fb-918c-32856e1b5136", "name": "network-vif-plugged", "status": "completed", "tag": "225efc65-26fe-4d54-93aa-35298d6ddd3f"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:58:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d248f754-c282-47c0-9b7f-6f7a3106e421 req-a06ecb19-064a-4490-a75c-b7e643c513b6 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d248f754-c282-47c0-9b7f-6f7a3106e421 req-a06ecb19-064a-4490-a75c-b7e643c513b6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d248f754-c282-47c0-9b7f-6f7a3106e421 req-a06ecb19-064a-4490-a75c-b7e643c513b6 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-d248f754-c282-47c0-9b7f-6f7a3106e421 req-a06ecb19-064a-4490-a75c-b7e643c513b6 service nova] Creating event network-vif-plugged:225efc65-26fe-4d54-93aa-35298d6ddd3f for instance 0cb22a78-94df-49fb-918c-32856e1b5136 on user Apr 12 10:58:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-d248f754-c282-47c0-9b7f-6f7a3106e421 req-a06ecb19-064a-4490-a75c-b7e643c513b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031180 Apr 12 10:58:24 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 334/983] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:58:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:58:26 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-0f776c80-f093-4699-afd1-1c26d0e36ee2 req-600cee84-7646-4967-83f2-db4b34ac2a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca545a0c-89fd-4a04-9d87-c2698051ca87", "tag": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:58:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0f776c80-f093-4699-afd1-1c26d0e36ee2 req-600cee84-7646-4967-83f2-db4b34ac2a1c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0f776c80-f093-4699-afd1-1c26d0e36ee2 req-600cee84-7646-4967-83f2-db4b34ac2a1c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0f776c80-f093-4699-afd1-1c26d0e36ee2 req-600cee84-7646-4967-83f2-db4b34ac2a1c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-0f776c80-f093-4699-afd1-1c26d0e36ee2 req-600cee84-7646-4967-83f2-db4b34ac2a1c service nova] Creating event network-changed:4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 for instance ca545a0c-89fd-4a04-9d87-c2698051ca87 on user Apr 12 10:58:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-0f776c80-f093-4699-afd1-1c26d0e36ee2 req-600cee84-7646-4967-83f2-db4b34ac2a1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037568 Apr 12 10:58:26 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 323/984] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:58:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:58:28 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-15fc3479-8e42-4e71-b2a7-cea6b82aba4c req-9de70aff-4e80-4405-9e06-79d2be62182e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca545a0c-89fd-4a04-9d87-c2698051ca87", "name": "network-vif-plugged", "status": "completed", "tag": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:58:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-15fc3479-8e42-4e71-b2a7-cea6b82aba4c req-9de70aff-4e80-4405-9e06-79d2be62182e service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-15fc3479-8e42-4e71-b2a7-cea6b82aba4c req-9de70aff-4e80-4405-9e06-79d2be62182e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-15fc3479-8e42-4e71-b2a7-cea6b82aba4c req-9de70aff-4e80-4405-9e06-79d2be62182e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:28 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-15fc3479-8e42-4e71-b2a7-cea6b82aba4c req-9de70aff-4e80-4405-9e06-79d2be62182e service nova] Creating event network-vif-plugged:4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 for instance ca545a0c-89fd-4a04-9d87-c2698051ca87 on user Apr 12 10:58:28 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-15fc3479-8e42-4e71-b2a7-cea6b82aba4c req-9de70aff-4e80-4405-9e06-79d2be62182e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058250 Apr 12 10:58:28 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 328/985] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:58:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:58:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-aa3a5678-39c2-496c-9c9f-be69b60bfb86 req-0c8efb40-552c-4c41-9743-407db9d8291c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca545a0c-89fd-4a04-9d87-c2698051ca87", "name": "network-vif-plugged", "status": "completed", "tag": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:58:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-aa3a5678-39c2-496c-9c9f-be69b60bfb86 req-0c8efb40-552c-4c41-9743-407db9d8291c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-aa3a5678-39c2-496c-9c9f-be69b60bfb86 req-0c8efb40-552c-4c41-9743-407db9d8291c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-aa3a5678-39c2-496c-9c9f-be69b60bfb86 req-0c8efb40-552c-4c41-9743-407db9d8291c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-aa3a5678-39c2-496c-9c9f-be69b60bfb86 req-0c8efb40-552c-4c41-9743-407db9d8291c service nova] Creating event network-vif-plugged:4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 for instance ca545a0c-89fd-4a04-9d87-c2698051ca87 on user Apr 12 10:58:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-aa3a5678-39c2-496c-9c9f-be69b60bfb86 req-0c8efb40-552c-4c41-9743-407db9d8291c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037010 Apr 12 10:58:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 335/986] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:58:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:58:31 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:58:31 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:58:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:31 user devstack@n-api.service[61853]: DEBUG nova.objects.instance [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'services' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=61853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:58:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644/os-volume_attachments/811e93eb-e600-41b9-ad7c-577a0f9938d1" status: 202 len: 0 microversion: 2.1 time: 0.352297 Apr 12 10:58:31 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 324/987] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 10:58:31 2023] DELETE /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644/os-volume_attachments/811e93eb-e600-41b9-ad7c-577a0f9938d1 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:58:33 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-05878093-8003-4d87-85e3-ec3ba68bbbd8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:58:33 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:58:33 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=10 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:58:33 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-05878093-8003-4d87-85e3-ec3ba68bbbd8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:33 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-05878093-8003-4d87-85e3-ec3ba68bbbd8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:33 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-05878093-8003-4d87-85e3-ec3ba68bbbd8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:33 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-05878093-8003-4d87-85e3-ec3ba68bbbd8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Going to try to stop instance {{(pid=61852) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 12 10:58:33 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-05878093-8003-4d87-85e3-ec3ba68bbbd8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644/action" status: 202 len: 0 microversion: 2.1 time: 0.085226 Apr 12 10:58:33 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 329/988] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 10:58:33 2023] POST /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:58:33 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:58:33 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-4e5feaca-0499-4244-b6cd-dc789a119568 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:58:33 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-4e5feaca-0499-4244-b6cd-dc789a119568 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:58:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4e5feaca-0499-4244-b6cd-dc789a119568 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4e5feaca-0499-4244-b6cd-dc789a119568 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4e5feaca-0499-4244-b6cd-dc789a119568 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4e5feaca-0499-4244-b6cd-dc789a119568 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4e5feaca-0499-4244-b6cd-dc789a119568 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-4e5feaca-0499-4244-b6cd-dc789a119568 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:33 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-4e5feaca-0499-4244-b6cd-dc789a119568 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6576467073e41e9b497097d5a8dfd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9878bfe34ceb4a6695b253ad161c4f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:58:33 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-4e5feaca-0499-4244-b6cd-dc789a119568 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644" status: 200 len: 1666 microversion: 2.1 time: 0.167285 Apr 12 10:58:33 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 336/989] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:58:33 2023] GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644 => generated 1666 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:58:33 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-454cd19e-9a99-4cc4-90e9-4ef07ae229ec req-027fa4f0-a704-4b05-8440-3f38cf7b93b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aef35e7-5daf-4d41-b91b-a7ff4a481644", "name": "network-vif-unplugged", "status": "completed", "tag": "8786a087-f036-403b-9b82-c75fc6dbb110"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:58:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-454cd19e-9a99-4cc4-90e9-4ef07ae229ec req-027fa4f0-a704-4b05-8440-3f38cf7b93b9 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-454cd19e-9a99-4cc4-90e9-4ef07ae229ec req-027fa4f0-a704-4b05-8440-3f38cf7b93b9 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:33 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-454cd19e-9a99-4cc4-90e9-4ef07ae229ec req-027fa4f0-a704-4b05-8440-3f38cf7b93b9 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:33 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-454cd19e-9a99-4cc4-90e9-4ef07ae229ec req-027fa4f0-a704-4b05-8440-3f38cf7b93b9 service nova] Creating event network-vif-unplugged:8786a087-f036-403b-9b82-c75fc6dbb110 for instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 on user Apr 12 10:58:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-454cd19e-9a99-4cc4-90e9-4ef07ae229ec req-027fa4f0-a704-4b05-8440-3f38cf7b93b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037857 Apr 12 10:58:34 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 325/990] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:58:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:58:36 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-2681c131-1853-48c3-970c-8f1e5581e45c req-b8457a89-0c6f-492c-8534-10b29a3c5588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aef35e7-5daf-4d41-b91b-a7ff4a481644", "name": "network-vif-plugged", "status": "completed", "tag": "8786a087-f036-403b-9b82-c75fc6dbb110"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:58:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-2681c131-1853-48c3-970c-8f1e5581e45c req-b8457a89-0c6f-492c-8534-10b29a3c5588 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-2681c131-1853-48c3-970c-8f1e5581e45c req-b8457a89-0c6f-492c-8534-10b29a3c5588 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:36 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-2681c131-1853-48c3-970c-8f1e5581e45c req-b8457a89-0c6f-492c-8534-10b29a3c5588 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:36 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-2681c131-1853-48c3-970c-8f1e5581e45c req-b8457a89-0c6f-492c-8534-10b29a3c5588 service nova] Creating event network-vif-plugged:8786a087-f036-403b-9b82-c75fc6dbb110 for instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 on user Apr 12 10:58:36 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-2681c131-1853-48c3-970c-8f1e5581e45c req-b8457a89-0c6f-492c-8534-10b29a3c5588 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031807 Apr 12 10:58:36 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 330/991] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:58:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:58:44 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=12 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:58:44 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=16 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:58:44 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d4a9044a-de9a-4e52-94f7-f358a5d6232a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:58:44 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d4a9044a-de9a-4e52-94f7-f358a5d6232a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:58:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d4a9044a-de9a-4e52-94f7-f358a5d6232a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d4a9044a-de9a-4e52-94f7-f358a5d6232a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d4a9044a-de9a-4e52-94f7-f358a5d6232a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d4a9044a-de9a-4e52-94f7-f358a5d6232a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d4a9044a-de9a-4e52-94f7-f358a5d6232a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d4a9044a-de9a-4e52-94f7-f358a5d6232a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-d4a9044a-de9a-4e52-94f7-f358a5d6232a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] HTTP exception thrown: Instance faa11b52-f2b6-45aa-937f-7468095ddb22 could not be found. Apr 12 10:58:44 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d4a9044a-de9a-4e52-94f7-f358a5d6232a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Request method failure captured: Apr 12 10:58:44 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22 HTTP/1.1 Apr 12 10:58:44 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:58:44 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:58:44 user devstack@n-api.service[61854]: Connection: close Apr 12 10:58:44 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:58:44 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:58:44 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:58:44 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:58:44 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:58:44 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNosqGCy9LHgGo-Yndp_Ix86dPoADuTrnm_RImsbY43eqA9xWhvyiivJnioJ9z9p3RlxFBVMsvx400Bp1v_lrKGOZVyQ8-QQERpwxm8kerR5X4hr_sxNED11I87boYZJQ5SrrIjm9pfsA1H5fYaQPT7mBTJHETLyCcAwgOQ0Bd95rMsc Apr 12 10:58:44 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:58:44 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:58:44 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:58:44 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:58:44 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:58:44 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:58:44 user devstack@n-api.service[61854]: X-Project-Id: 2b39cd8e55b54a86a7784f2934273e20 Apr 12 10:58:44 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1632398833 Apr 12 10:58:44 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:58:44 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:58:44 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2b39cd8e55b54a86a7784f2934273e20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b39cd8e55b54a86a7784f2934273e20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b39cd8e55b54a86a7784f2934273e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:58:44 user devstack@n-api.service[61854]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1632398833 Apr 12 10:58:44 user devstack@n-api.service[61854]: X-Tenant-Id: 2b39cd8e55b54a86a7784f2934273e20 Apr 12 10:58:44 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1632398833 Apr 12 10:58:44 user devstack@n-api.service[61854]: X-User: tempest-ServerRescueNegativeTestJSON-1632398833-project-member Apr 12 10:58:44 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:58:44 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:58:44 user devstack@n-api.service[61854]: X-User-Id: abdf772f2c7341c29159b6f1f2ce7ccb Apr 12 10:58:44 user devstack@n-api.service[61854]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1632398833-project-member Apr 12 10:58:44 user devstack@n-api.service[61854]: method: > Apr 12 10:58:44 user devstack@n-api.service[61854]: exception: Instance faa11b52-f2b6-45aa-937f-7468095ddb22 could not be found. Apr 12 10:58:44 user devstack@n-api.service[61854]: action_args: {'id': 'faa11b52-f2b6-45aa-937f-7468095ddb22'} Apr 12 10:58:44 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faa11b52-f2b6-45aa-937f-7468095ddb22 could not be found. Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faa11b52-f2b6-45aa-937f-7468095ddb22 could not be found. Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faa11b52-f2b6-45aa-937f-7468095ddb22 could not be found. Apr 12 10:58:44 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:58:44 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d4a9044a-de9a-4e52-94f7-f358a5d6232a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Returning 404 to user: Instance faa11b52-f2b6-45aa-937f-7468095ddb22 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:58:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d4a9044a-de9a-4e52-94f7-f358a5d6232a tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22" status: 404 len: 111 microversion: 2.1 time: 0.037185 Apr 12 10:58:44 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 337/992] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:58:44 2023] GET /compute/v2.1/servers/faa11b52-f2b6-45aa-937f-7468095ddb22 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:58:44 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:58:44 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:58:44 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1db7d020-4886-4496-af9c-03e1f5a2ad3f tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '.version_select at 0x7fabbf6ce710>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:58:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1db7d020-4886-4496-af9c-03e1f5a2ad3f tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1748374270" status: 202 len: 0 microversion: 2.1 time: 0.030707 Apr 12 10:58:44 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 326/993] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 10:58:44 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1748374270 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:58:49 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:58:49 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:58:49 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:58:49 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:58:49 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:49 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:49 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:49 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:49 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:49 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:49 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:58:49 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/97bafe22-36bf-4939-baf8-9602551bad52" status: 204 len: 0 microversion: 2.1 time: 0.178807 Apr 12 10:58:49 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 331/994] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:58:49 2023] DELETE /compute/v2.1/servers/97bafe22-36bf-4939-baf8-9602551bad52 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:58:49 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-bfae261f-2086-45e6-8a69-2b64d39f97a6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:58:49 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-bfae261f-2086-45e6-8a69-2b64d39f97a6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:58:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bfae261f-2086-45e6-8a69-2b64d39f97a6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bfae261f-2086-45e6-8a69-2b64d39f97a6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bfae261f-2086-45e6-8a69-2b64d39f97a6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bfae261f-2086-45e6-8a69-2b64d39f97a6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bfae261f-2086-45e6-8a69-2b64d39f97a6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:49 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bfae261f-2086-45e6-8a69-2b64d39f97a6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:49 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-bfae261f-2086-45e6-8a69-2b64d39f97a6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:58:49 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-bfae261f-2086-45e6-8a69-2b64d39f97a6 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97bafe22-36bf-4939-baf8-9602551bad52" status: 200 len: 1495 microversion: 2.1 time: 0.189186 Apr 12 10:58:49 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 338/995] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:58:49 2023] GET /compute/v2.1/servers/97bafe22-36bf-4939-baf8-9602551bad52 => generated 1495 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:58:49 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-47e7aba9-4933-47d3-831e-3ec74225936a req-da1d5435-94f3-494f-b976-204ccdac9888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97bafe22-36bf-4939-baf8-9602551bad52", "name": "network-vif-unplugged", "status": "completed", "tag": "580ed46e-ff10-494f-b864-42eda726a7ff"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:58:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-47e7aba9-4933-47d3-831e-3ec74225936a req-da1d5435-94f3-494f-b976-204ccdac9888 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-47e7aba9-4933-47d3-831e-3ec74225936a req-da1d5435-94f3-494f-b976-204ccdac9888 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:49 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-47e7aba9-4933-47d3-831e-3ec74225936a req-da1d5435-94f3-494f-b976-204ccdac9888 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:49 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-47e7aba9-4933-47d3-831e-3ec74225936a req-da1d5435-94f3-494f-b976-204ccdac9888 service nova] Creating event network-vif-unplugged:580ed46e-ff10-494f-b864-42eda726a7ff for instance 97bafe22-36bf-4939-baf8-9602551bad52 on user Apr 12 10:58:49 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-47e7aba9-4933-47d3-831e-3ec74225936a req-da1d5435-94f3-494f-b976-204ccdac9888 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030268 Apr 12 10:58:49 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 327/996] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:58:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:58:51 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-eed6b2d0-7b6a-43e2-9790-1a9144f723fa req-7ade8e5d-0c1c-4f73-b755-2eb5a066aa67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97bafe22-36bf-4939-baf8-9602551bad52", "name": "network-vif-plugged", "status": "completed", "tag": "580ed46e-ff10-494f-b864-42eda726a7ff"}, {"server_uuid": "97bafe22-36bf-4939-baf8-9602551bad52", "name": "network-vif-deleted", "tag": "580ed46e-ff10-494f-b864-42eda726a7ff"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:58:51 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-eed6b2d0-7b6a-43e2-9790-1a9144f723fa req-7ade8e5d-0c1c-4f73-b755-2eb5a066aa67 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:58:51 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-eed6b2d0-7b6a-43e2-9790-1a9144f723fa req-7ade8e5d-0c1c-4f73-b755-2eb5a066aa67 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:58:51 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-eed6b2d0-7b6a-43e2-9790-1a9144f723fa req-7ade8e5d-0c1c-4f73-b755-2eb5a066aa67 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:58:51 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-eed6b2d0-7b6a-43e2-9790-1a9144f723fa req-7ade8e5d-0c1c-4f73-b755-2eb5a066aa67 service nova] Creating event network-vif-plugged:580ed46e-ff10-494f-b864-42eda726a7ff for instance 97bafe22-36bf-4939-baf8-9602551bad52 on user Apr 12 10:58:51 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-eed6b2d0-7b6a-43e2-9790-1a9144f723fa req-7ade8e5d-0c1c-4f73-b755-2eb5a066aa67 service nova] Creating event network-vif-deleted:580ed46e-ff10-494f-b864-42eda726a7ff for instance 97bafe22-36bf-4939-baf8-9602551bad52 on user Apr 12 10:58:51 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-eed6b2d0-7b6a-43e2-9790-1a9144f723fa req-7ade8e5d-0c1c-4f73-b755-2eb5a066aa67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039164 Apr 12 10:58:51 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 332/997] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:58:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:59:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-e0e99596-cae0-4983-a70a-fff2a97a1707 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:59:08 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-e0e99596-cae0-4983-a70a-fff2a97a1707 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:59:08 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:59:08 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=8 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:59:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e0e99596-cae0-4983-a70a-fff2a97a1707 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e0e99596-cae0-4983-a70a-fff2a97a1707 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e0e99596-cae0-4983-a70a-fff2a97a1707 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e0e99596-cae0-4983-a70a-fff2a97a1707 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e0e99596-cae0-4983-a70a-fff2a97a1707 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-e0e99596-cae0-4983-a70a-fff2a97a1707 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:08 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-e0e99596-cae0-4983-a70a-fff2a97a1707 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed741675f5944f1882c097c411437f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0f2b52a1a04769803c3a44a924ff00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:59:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-e0e99596-cae0-4983-a70a-fff2a97a1707 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6" status: 200 len: 1540 microversion: 2.1 time: 0.152600 Apr 12 10:59:08 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 339/998] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:59:08 2023] GET /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6 => generated 1540 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:59:10 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-d7611463-f441-449c-ab4f-58728b994fdf req-2832ad2e-37ef-4c03-9bf6-1269e8a15917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faf5e629-c914-43a1-bd73-ce4adfafe9d6", "tag": "f43a5f64-a4b2-481b-9785-6a556a795d0a"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:59:10 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:59:10 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:59:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d7611463-f441-449c-ab4f-58728b994fdf req-2832ad2e-37ef-4c03-9bf6-1269e8a15917 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d7611463-f441-449c-ab4f-58728b994fdf req-2832ad2e-37ef-4c03-9bf6-1269e8a15917 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:10 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d7611463-f441-449c-ab4f-58728b994fdf req-2832ad2e-37ef-4c03-9bf6-1269e8a15917 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:10 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-d7611463-f441-449c-ab4f-58728b994fdf req-2832ad2e-37ef-4c03-9bf6-1269e8a15917 service nova] Creating event network-changed:f43a5f64-a4b2-481b-9785-6a556a795d0a for instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 on user Apr 12 10:59:10 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-d7611463-f441-449c-ab4f-58728b994fdf req-2832ad2e-37ef-4c03-9bf6-1269e8a15917 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046190 Apr 12 10:59:10 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 328/999] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:59:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:59:10 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:59:10 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:59:10 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc49aa26-cc0b-43ef-98df-a709f5ba48f5"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:59:10 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:59:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:11 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "POST /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294003 Apr 12 10:59:11 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 333/1000] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 10:59:10 2023] POST /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5c62f6d7-6f7c-4ccd-92d2-0f8e79942789 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-5c62f6d7-6f7c-4ccd-92d2-0f8e79942789 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5c62f6d7-6f7c-4ccd-92d2-0f8e79942789 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5c62f6d7-6f7c-4ccd-92d2-0f8e79942789 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5c62f6d7-6f7c-4ccd-92d2-0f8e79942789 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5c62f6d7-6f7c-4ccd-92d2-0f8e79942789 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5c62f6d7-6f7c-4ccd-92d2-0f8e79942789 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5c62f6d7-6f7c-4ccd-92d2-0f8e79942789 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-5c62f6d7-6f7c-4ccd-92d2-0f8e79942789 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] HTTP exception thrown: Instance 0cb22a78-94df-49fb-918c-32856e1b5136 could not be found. Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5c62f6d7-6f7c-4ccd-92d2-0f8e79942789 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Request method failure captured: Apr 12 10:59:11 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136 HTTP/1.1 Apr 12 10:59:11 user devstack@n-api.service[61854]: Accept: application/json Apr 12 10:59:11 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 10:59:11 user devstack@n-api.service[61854]: Connection: close Apr 12 10:59:11 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 10:59:11 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 10:59:11 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 10:59:11 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 10:59:11 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 10:59:11 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNolnZNzT2ThxhSuriBvxuvzWZTym4AlaZYFeuKEGLDsI4JQU5J5EPdqePhYq7aD0VLU4aPMYtUubtPCx4cTyFqrT8VJO6mTH-GETo4CcBCG0ZBRUEmmG4Xqag9VuceySJFT8Zl4MMu3msZfldyluyIaplQmRePuPI9QT24i1FtyI7ZE Apr 12 10:59:11 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 10:59:11 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 10:59:11 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 10:59:11 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 10:59:11 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 10:59:11 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 10:59:11 user devstack@n-api.service[61854]: X-Project-Id: 32235c67d269474b879a58269c1bfb28 Apr 12 10:59:11 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServerActionsTestJSON-2042231427 Apr 12 10:59:11 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 10:59:11 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 10:59:11 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/32235c67d269474b879a58269c1bfb28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32235c67d269474b879a58269c1bfb28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32235c67d269474b879a58269c1bfb28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:59:11 user devstack@n-api.service[61854]: X-Tenant: tempest-ServerActionsTestJSON-2042231427 Apr 12 10:59:11 user devstack@n-api.service[61854]: X-Tenant-Id: 32235c67d269474b879a58269c1bfb28 Apr 12 10:59:11 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServerActionsTestJSON-2042231427 Apr 12 10:59:11 user devstack@n-api.service[61854]: X-User: tempest-ServerActionsTestJSON-2042231427-project-member Apr 12 10:59:11 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 10:59:11 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 10:59:11 user devstack@n-api.service[61854]: X-User-Id: 0059d31539304ffcb5214b408751cd4f Apr 12 10:59:11 user devstack@n-api.service[61854]: X-User-Name: tempest-ServerActionsTestJSON-2042231427-project-member Apr 12 10:59:11 user devstack@n-api.service[61854]: method: > Apr 12 10:59:11 user devstack@n-api.service[61854]: exception: Instance 0cb22a78-94df-49fb-918c-32856e1b5136 could not be found. Apr 12 10:59:11 user devstack@n-api.service[61854]: action_args: {'id': '0cb22a78-94df-49fb-918c-32856e1b5136'} Apr 12 10:59:11 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cb22a78-94df-49fb-918c-32856e1b5136 could not be found. Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cb22a78-94df-49fb-918c-32856e1b5136 could not be found. Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cb22a78-94df-49fb-918c-32856e1b5136 could not be found. Apr 12 10:59:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5c62f6d7-6f7c-4ccd-92d2-0f8e79942789 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Returning 404 to user: Instance 0cb22a78-94df-49fb-918c-32856e1b5136 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:59:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5c62f6d7-6f7c-4ccd-92d2-0f8e79942789 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136" status: 404 len: 111 microversion: 2.1 time: 0.027788 Apr 12 10:59:11 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 340/1001] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:59:11 2023] GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f97aa6cd-22e6-4853-a7c5-20501377af8a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f97aa6cd-22e6-4853-a7c5-20501377af8a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f97aa6cd-22e6-4853-a7c5-20501377af8a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f97aa6cd-22e6-4853-a7c5-20501377af8a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f97aa6cd-22e6-4853-a7c5-20501377af8a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f97aa6cd-22e6-4853-a7c5-20501377af8a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f97aa6cd-22e6-4853-a7c5-20501377af8a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f97aa6cd-22e6-4853-a7c5-20501377af8a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:11 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-f97aa6cd-22e6-4853-a7c5-20501377af8a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] HTTP exception thrown: Instance 0cb22a78-94df-49fb-918c-32856e1b5136 could not be found. Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f97aa6cd-22e6-4853-a7c5-20501377af8a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Request method failure captured: Apr 12 10:59:11 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136 HTTP/1.1 Apr 12 10:59:11 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:59:11 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:59:11 user devstack@n-api.service[61853]: Connection: close Apr 12 10:59:11 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:59:11 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:59:11 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:59:11 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:59:11 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:59:11 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolnZNzT2ThxhSuriBvxuvzWZTym4AlaZYFeuKEGLDsI4JQU5J5EPdqePhYq7aD0VLU4aPMYtUubtPCx4cTyFqrT8VJO6mTH-GETo4CcBCG0ZBRUEmmG4Xqag9VuceySJFT8Zl4MMu3msZfldyluyIaplQmRePuPI9QT24i1FtyI7ZE Apr 12 10:59:11 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:59:11 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:59:11 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:59:11 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:59:11 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:59:11 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:59:11 user devstack@n-api.service[61853]: X-Project-Id: 32235c67d269474b879a58269c1bfb28 Apr 12 10:59:11 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServerActionsTestJSON-2042231427 Apr 12 10:59:11 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:59:11 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:59:11 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/32235c67d269474b879a58269c1bfb28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32235c67d269474b879a58269c1bfb28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32235c67d269474b879a58269c1bfb28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:59:11 user devstack@n-api.service[61853]: X-Tenant: tempest-ServerActionsTestJSON-2042231427 Apr 12 10:59:11 user devstack@n-api.service[61853]: X-Tenant-Id: 32235c67d269474b879a58269c1bfb28 Apr 12 10:59:11 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServerActionsTestJSON-2042231427 Apr 12 10:59:11 user devstack@n-api.service[61853]: X-User: tempest-ServerActionsTestJSON-2042231427-project-member Apr 12 10:59:11 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:59:11 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:59:11 user devstack@n-api.service[61853]: X-User-Id: 0059d31539304ffcb5214b408751cd4f Apr 12 10:59:11 user devstack@n-api.service[61853]: X-User-Name: tempest-ServerActionsTestJSON-2042231427-project-member Apr 12 10:59:11 user devstack@n-api.service[61853]: method: > Apr 12 10:59:11 user devstack@n-api.service[61853]: exception: Instance 0cb22a78-94df-49fb-918c-32856e1b5136 could not be found. Apr 12 10:59:11 user devstack@n-api.service[61853]: action_args: {'id': '0cb22a78-94df-49fb-918c-32856e1b5136'} Apr 12 10:59:11 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cb22a78-94df-49fb-918c-32856e1b5136 could not be found. Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cb22a78-94df-49fb-918c-32856e1b5136 could not be found. Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cb22a78-94df-49fb-918c-32856e1b5136 could not be found. Apr 12 10:59:11 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f97aa6cd-22e6-4853-a7c5-20501377af8a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Returning 404 to user: Instance 0cb22a78-94df-49fb-918c-32856e1b5136 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:59:11 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f97aa6cd-22e6-4853-a7c5-20501377af8a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136" status: 404 len: 111 microversion: 2.1 time: 0.031450 Apr 12 10:59:11 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 329/1002] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:59:11 2023] DELETE /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:59:11 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-959bd09a-3248-4b46-ad92-64f73f8c2947 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:59:11 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-959bd09a-3248-4b46-ad92-64f73f8c2947 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:59:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-959bd09a-3248-4b46-ad92-64f73f8c2947 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-959bd09a-3248-4b46-ad92-64f73f8c2947 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-959bd09a-3248-4b46-ad92-64f73f8c2947 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-959bd09a-3248-4b46-ad92-64f73f8c2947 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-959bd09a-3248-4b46-ad92-64f73f8c2947 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-959bd09a-3248-4b46-ad92-64f73f8c2947 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:11 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-959bd09a-3248-4b46-ad92-64f73f8c2947 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] HTTP exception thrown: Instance 0cb22a78-94df-49fb-918c-32856e1b5136 could not be found. Apr 12 10:59:11 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-959bd09a-3248-4b46-ad92-64f73f8c2947 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Request method failure captured: Apr 12 10:59:11 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136 HTTP/1.1 Apr 12 10:59:11 user devstack@n-api.service[61852]: Accept: application/json Apr 12 10:59:11 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 10:59:11 user devstack@n-api.service[61852]: Connection: close Apr 12 10:59:11 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 10:59:11 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 10:59:11 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 10:59:11 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 10:59:11 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 10:59:11 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNolnZNzT2ThxhSuriBvxuvzWZTym4AlaZYFeuKEGLDsI4JQU5J5EPdqePhYq7aD0VLU4aPMYtUubtPCx4cTyFqrT8VJO6mTH-GETo4CcBCG0ZBRUEmmG4Xqag9VuceySJFT8Zl4MMu3msZfldyluyIaplQmRePuPI9QT24i1FtyI7ZE Apr 12 10:59:11 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 10:59:11 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 10:59:11 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 10:59:11 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 10:59:11 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 10:59:11 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 10:59:11 user devstack@n-api.service[61852]: X-Project-Id: 32235c67d269474b879a58269c1bfb28 Apr 12 10:59:11 user devstack@n-api.service[61852]: X-Project-Name: tempest-ServerActionsTestJSON-2042231427 Apr 12 10:59:11 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 10:59:11 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 10:59:11 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/32235c67d269474b879a58269c1bfb28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32235c67d269474b879a58269c1bfb28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32235c67d269474b879a58269c1bfb28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:59:11 user devstack@n-api.service[61852]: X-Tenant: tempest-ServerActionsTestJSON-2042231427 Apr 12 10:59:11 user devstack@n-api.service[61852]: X-Tenant-Id: 32235c67d269474b879a58269c1bfb28 Apr 12 10:59:11 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-ServerActionsTestJSON-2042231427 Apr 12 10:59:11 user devstack@n-api.service[61852]: X-User: tempest-ServerActionsTestJSON-2042231427-project-member Apr 12 10:59:11 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 10:59:11 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 10:59:11 user devstack@n-api.service[61852]: X-User-Id: 0059d31539304ffcb5214b408751cd4f Apr 12 10:59:11 user devstack@n-api.service[61852]: X-User-Name: tempest-ServerActionsTestJSON-2042231427-project-member Apr 12 10:59:11 user devstack@n-api.service[61852]: method: > Apr 12 10:59:11 user devstack@n-api.service[61852]: exception: Instance 0cb22a78-94df-49fb-918c-32856e1b5136 could not be found. Apr 12 10:59:11 user devstack@n-api.service[61852]: action_args: {'id': '0cb22a78-94df-49fb-918c-32856e1b5136'} Apr 12 10:59:11 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cb22a78-94df-49fb-918c-32856e1b5136 could not be found. Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cb22a78-94df-49fb-918c-32856e1b5136 could not be found. Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cb22a78-94df-49fb-918c-32856e1b5136 could not be found. Apr 12 10:59:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 10:59:11 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-959bd09a-3248-4b46-ad92-64f73f8c2947 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Returning 404 to user: Instance 0cb22a78-94df-49fb-918c-32856e1b5136 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:59:11 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-959bd09a-3248-4b46-ad92-64f73f8c2947 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136" status: 404 len: 111 microversion: 2.1 time: 0.034002 Apr 12 10:59:11 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 334/1003] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:59:11 2023] GET /compute/v2.1/servers/0cb22a78-94df-49fb-918c-32856e1b5136 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:11 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:59:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" status: 204 len: 0 microversion: 2.1 time: 0.125027 Apr 12 10:59:11 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 341/1004] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:59:11 2023] DELETE /compute/v2.1/servers/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-986b4bfe-9d8d-4ce1-8da0-d0fd2f2f192f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-986b4bfe-9d8d-4ce1-8da0-d0fd2f2f192f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-986b4bfe-9d8d-4ce1-8da0-d0fd2f2f192f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-986b4bfe-9d8d-4ce1-8da0-d0fd2f2f192f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-986b4bfe-9d8d-4ce1-8da0-d0fd2f2f192f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-986b4bfe-9d8d-4ce1-8da0-d0fd2f2f192f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-986b4bfe-9d8d-4ce1-8da0-d0fd2f2f192f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-986b4bfe-9d8d-4ce1-8da0-d0fd2f2f192f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:11 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-986b4bfe-9d8d-4ce1-8da0-d0fd2f2f192f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:59:11 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-986b4bfe-9d8d-4ce1-8da0-d0fd2f2f192f tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" status: 200 len: 1545 microversion: 2.1 time: 0.201572 Apr 12 10:59:11 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 330/1005] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:59:11 2023] GET /compute/v2.1/servers/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 => generated 1545 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:59:12 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-e220c35a-23d9-4ae5-98a1-b8ea03356016 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:59:12 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-e220c35a-23d9-4ae5-98a1-b8ea03356016 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:59:12 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e220c35a-23d9-4ae5-98a1-b8ea03356016 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:12 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e220c35a-23d9-4ae5-98a1-b8ea03356016 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:12 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e220c35a-23d9-4ae5-98a1-b8ea03356016 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:12 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e220c35a-23d9-4ae5-98a1-b8ea03356016 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:12 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e220c35a-23d9-4ae5-98a1-b8ea03356016 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:12 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-e220c35a-23d9-4ae5-98a1-b8ea03356016 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:12 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-e220c35a-23d9-4ae5-98a1-b8ea03356016 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325a0abaf7b6485ca97e2d2af2bc9778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7541fb4f462b438dbef4ffe9be4725b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:59:12 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-e220c35a-23d9-4ae5-98a1-b8ea03356016 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87" status: 200 len: 1568 microversion: 2.1 time: 0.160589 Apr 12 10:59:12 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 335/1006] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:59:12 2023] GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:59:12 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23", "name": "network-vif-unplugged", "status": "completed", "tag": "59e0f8a4-966b-46f3-921d-be0c6f15f281"}, {"server_uuid": "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23", "name": "network-vif-plugged", "status": "completed", "tag": "59e0f8a4-966b-46f3-921d-be0c6f15f281"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:59:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] Creating event network-vif-unplugged:59e0f8a4-966b-46f3-921d-be0c6f15f281 for instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 on user Apr 12 10:59:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] Creating event network-vif-plugged:59e0f8a4-966b-46f3-921d-be0c6f15f281 for instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 on user Apr 12 10:59:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029876 Apr 12 10:59:12 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 342/1007] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:59:12 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:59:12 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-c9dc0658-1589-4949-8c1a-3a60cf7f0085 req-8592b09b-cb1d-4e53-aa5c-f8e662faa9bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23", "name": "network-vif-deleted", "tag": "59e0f8a4-966b-46f3-921d-be0c6f15f281"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:59:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-c9dc0658-1589-4949-8c1a-3a60cf7f0085 req-8592b09b-cb1d-4e53-aa5c-f8e662faa9bc service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-c9dc0658-1589-4949-8c1a-3a60cf7f0085 req-8592b09b-cb1d-4e53-aa5c-f8e662faa9bc service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-c9dc0658-1589-4949-8c1a-3a60cf7f0085 req-8592b09b-cb1d-4e53-aa5c-f8e662faa9bc service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-c9dc0658-1589-4949-8c1a-3a60cf7f0085 req-8592b09b-cb1d-4e53-aa5c-f8e662faa9bc service nova] Creating event network-vif-deleted:59e0f8a4-966b-46f3-921d-be0c6f15f281 for instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 on user Apr 12 10:59:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-c9dc0658-1589-4949-8c1a-3a60cf7f0085 req-8592b09b-cb1d-4e53-aa5c-f8e662faa9bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028302 Apr 12 10:59:13 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 331/1008] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:59:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:59:18 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:59:18 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:59:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:18 user devstack@n-api.service[61852]: DEBUG nova.objects.instance [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lazy-loading 'services' on Instance uuid faf5e629-c914-43a1-bd73-ce4adfafe9d6 {{(pid=61852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 10:59:18 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6/os-volume_attachments/fc49aa26-cc0b-43ef-98df-a709f5ba48f5" status: 202 len: 0 microversion: 2.1 time: 0.159347 Apr 12 10:59:18 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 336/1009] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 10:59:18 2023] DELETE /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6/os-volume_attachments/fc49aa26-cc0b-43ef-98df-a709f5ba48f5 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 10:59:18 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-a4f65e1d-afbf-4ac2-bd3b-795cbcbec4f9 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:59:18 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-a4f65e1d-afbf-4ac2-bd3b-795cbcbec4f9 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:59:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a4f65e1d-afbf-4ac2-bd3b-795cbcbec4f9 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a4f65e1d-afbf-4ac2-bd3b-795cbcbec4f9 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a4f65e1d-afbf-4ac2-bd3b-795cbcbec4f9 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a4f65e1d-afbf-4ac2-bd3b-795cbcbec4f9 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a4f65e1d-afbf-4ac2-bd3b-795cbcbec4f9 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:18 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-a4f65e1d-afbf-4ac2-bd3b-795cbcbec4f9 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:18 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-a4f65e1d-afbf-4ac2-bd3b-795cbcbec4f9 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041448 Apr 12 10:59:18 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 343/1010] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 10:59:18 2023] GET /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:59:23 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=8 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:59:23 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=12 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:59:23 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8fbc537b-7962-4458-9323-1bba6e9eb1a2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:59:23 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-8fbc537b-7962-4458-9323-1bba6e9eb1a2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:59:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8fbc537b-7962-4458-9323-1bba6e9eb1a2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8fbc537b-7962-4458-9323-1bba6e9eb1a2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8fbc537b-7962-4458-9323-1bba6e9eb1a2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8fbc537b-7962-4458-9323-1bba6e9eb1a2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8fbc537b-7962-4458-9323-1bba6e9eb1a2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8fbc537b-7962-4458-9323-1bba6e9eb1a2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:23 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-418ba9d9-c1b9-496d-99b5-75aa23db46bd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:59:23 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-418ba9d9-c1b9-496d-99b5-75aa23db46bd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:59:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-418ba9d9-c1b9-496d-99b5-75aa23db46bd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-418ba9d9-c1b9-496d-99b5-75aa23db46bd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-418ba9d9-c1b9-496d-99b5-75aa23db46bd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-418ba9d9-c1b9-496d-99b5-75aa23db46bd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-418ba9d9-c1b9-496d-99b5-75aa23db46bd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:23 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-418ba9d9-c1b9-496d-99b5-75aa23db46bd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:24 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-8fbc537b-7962-4458-9323-1bba6e9eb1a2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6576467073e41e9b497097d5a8dfd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9878bfe34ceb4a6695b253ad161c4f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:59:24 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8fbc537b-7962-4458-9323-1bba6e9eb1a2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644" status: 200 len: 1643 microversion: 2.1 time: 0.155822 Apr 12 10:59:24 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 332/1011] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:59:23 2023] GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644 => generated 1643 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:59:24 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-418ba9d9-c1b9-496d-99b5-75aa23db46bd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:59:24 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-418ba9d9-c1b9-496d-99b5-75aa23db46bd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" status: 200 len: 1440 microversion: 2.1 time: 0.147477 Apr 12 10:59:24 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 337/1012] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:59:23 2023] GET /compute/v2.1/servers/e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 => generated 1440 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:59:25 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-96a1a0c5-0dee-4998-b980-a2e1af6eee73 req-0ae6b4f5-f590-4325-b08d-1204bc5e6b53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280", "tag": "f0316e9d-800d-42f6-9078-eafa6da69f0d"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:59:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-96a1a0c5-0dee-4998-b980-a2e1af6eee73 req-0ae6b4f5-f590-4325-b08d-1204bc5e6b53 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-96a1a0c5-0dee-4998-b980-a2e1af6eee73 req-0ae6b4f5-f590-4325-b08d-1204bc5e6b53 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-96a1a0c5-0dee-4998-b980-a2e1af6eee73 req-0ae6b4f5-f590-4325-b08d-1204bc5e6b53 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-96a1a0c5-0dee-4998-b980-a2e1af6eee73 req-0ae6b4f5-f590-4325-b08d-1204bc5e6b53 service nova] Creating event network-changed:f0316e9d-800d-42f6-9078-eafa6da69f0d for instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 on user Apr 12 10:59:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-96a1a0c5-0dee-4998-b980-a2e1af6eee73 req-0ae6b4f5-f590-4325-b08d-1204bc5e6b53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030477 Apr 12 10:59:25 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 344/1013] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:59:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:59:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1577337770", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-162796269", "security_groups": [{"name": "tempest-secgroup-smoke-188917005"}], "block_device_mapping_v2": [{"uuid": "3e779651-b7b5-4fa7-8451-d72ec750c44d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3ecf6069-4851-431c-a1c3-13e94566fa0b"}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:59:31 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] validate_networks() for [('3ecf6069-4851-431c-a1c3-13e94566fa0b', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 10:59:31 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 10:59:31 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 10:59:31 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 10:59:31 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 10:59:31 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 10:59:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:31 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:31 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting quotas for project a67f3d23b8f74a9496d445c7fc75717e. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 10:59:31 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting quotas for user b914d7ca786f455baf120f98816abffd and project a67f3d23b8f74a9496d445c7fc75717e. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 10:59:31 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 10:59:31 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e779651-b7b5-4fa7-8451-d72ec750c44d',volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 10:59:31 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.860636 Apr 12 10:59:31 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 333/1014] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 10:59:30 2023] POST /compute/v2.1/servers => generated 403 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 10:59:31 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-751957ae-cdca-40b9-bc5e-40dc31c38689 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:59:31 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-751957ae-cdca-40b9-bc5e-40dc31c38689 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:59:31 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-751957ae-cdca-40b9-bc5e-40dc31c38689 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:59:31 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-751957ae-cdca-40b9-bc5e-40dc31c38689 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/948c893b-1292-4b9a-8c77-0e23c94387ae" status: 200 len: 1089 microversion: 2.1 time: 0.083908 Apr 12 10:59:31 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 338/1015] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:59:31 2023] GET /compute/v2.1/servers/948c893b-1292-4b9a-8c77-0e23c94387ae => generated 1089 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:59:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-3ccc97f5-4cdc-4023-9b92-acc4ab9cbdc5 req-c723e3e3-a7e4-49f3-a826-2131e43058d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "948c893b-1292-4b9a-8c77-0e23c94387ae", "tag": "7c976cd8-54d9-4233-be62-1cecf9cc63c6"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:59:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3ccc97f5-4cdc-4023-9b92-acc4ab9cbdc5 req-c723e3e3-a7e4-49f3-a826-2131e43058d3 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3ccc97f5-4cdc-4023-9b92-acc4ab9cbdc5 req-c723e3e3-a7e4-49f3-a826-2131e43058d3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:34 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3ccc97f5-4cdc-4023-9b92-acc4ab9cbdc5 req-c723e3e3-a7e4-49f3-a826-2131e43058d3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-3ccc97f5-4cdc-4023-9b92-acc4ab9cbdc5 req-c723e3e3-a7e4-49f3-a826-2131e43058d3 service nova] Creating event network-changed:7c976cd8-54d9-4233-be62-1cecf9cc63c6 for instance 948c893b-1292-4b9a-8c77-0e23c94387ae on user Apr 12 10:59:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-3ccc97f5-4cdc-4023-9b92-acc4ab9cbdc5 req-c723e3e3-a7e4-49f3-a826-2131e43058d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029019 Apr 12 10:59:34 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 345/1016] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:59:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:59:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ca04e325-40e6-46eb-9830-84e0c8ea5197 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:59:39 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-ca04e325-40e6-46eb-9830-84e0c8ea5197 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:59:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ca04e325-40e6-46eb-9830-84e0c8ea5197 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ca04e325-40e6-46eb-9830-84e0c8ea5197 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ca04e325-40e6-46eb-9830-84e0c8ea5197 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ca04e325-40e6-46eb-9830-84e0c8ea5197 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ca04e325-40e6-46eb-9830-84e0c8ea5197 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:39 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ca04e325-40e6-46eb-9830-84e0c8ea5197 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-ca04e325-40e6-46eb-9830-84e0c8ea5197 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] HTTP exception thrown: Instance 97bafe22-36bf-4939-baf8-9602551bad52 could not be found. Apr 12 10:59:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ca04e325-40e6-46eb-9830-84e0c8ea5197 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Request method failure captured: Apr 12 10:59:39 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/97bafe22-36bf-4939-baf8-9602551bad52 HTTP/1.1 Apr 12 10:59:39 user devstack@n-api.service[61853]: Accept: application/json Apr 12 10:59:39 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 10:59:39 user devstack@n-api.service[61853]: Connection: close Apr 12 10:59:39 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 10:59:39 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 10:59:39 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 10:59:39 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 10:59:39 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 10:59:39 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNosqGCy9LHgGo-Yndp_Ix86dPoADuTrnm_RImsbY43eqA9xWhvyiivJnioJ9z9p3RlxFBVMsvx400Bp1v_lrKGOZVyQ8-QQERpwxm8kerR5X4hr_sxNED11I87boYZJQ5SrrIjm9pfsA1H5fYaQPT7mBTJHETLyCcAwgOQ0Bd95rMsc Apr 12 10:59:39 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 10:59:39 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 10:59:39 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 10:59:39 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 10:59:39 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 10:59:39 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 10:59:39 user devstack@n-api.service[61853]: X-Project-Id: 2b39cd8e55b54a86a7784f2934273e20 Apr 12 10:59:39 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1632398833 Apr 12 10:59:39 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 10:59:39 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 10:59:39 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2b39cd8e55b54a86a7784f2934273e20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b39cd8e55b54a86a7784f2934273e20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b39cd8e55b54a86a7784f2934273e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 10:59:39 user devstack@n-api.service[61853]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1632398833 Apr 12 10:59:39 user devstack@n-api.service[61853]: X-Tenant-Id: 2b39cd8e55b54a86a7784f2934273e20 Apr 12 10:59:39 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1632398833 Apr 12 10:59:39 user devstack@n-api.service[61853]: X-User: tempest-ServerRescueNegativeTestJSON-1632398833-project-member Apr 12 10:59:39 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 10:59:39 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 10:59:39 user devstack@n-api.service[61853]: X-User-Id: abdf772f2c7341c29159b6f1f2ce7ccb Apr 12 10:59:39 user devstack@n-api.service[61853]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1632398833-project-member Apr 12 10:59:39 user devstack@n-api.service[61853]: method: > Apr 12 10:59:39 user devstack@n-api.service[61853]: exception: Instance 97bafe22-36bf-4939-baf8-9602551bad52 could not be found. Apr 12 10:59:39 user devstack@n-api.service[61853]: action_args: {'id': '97bafe22-36bf-4939-baf8-9602551bad52'} Apr 12 10:59:39 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97bafe22-36bf-4939-baf8-9602551bad52 could not be found. Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97bafe22-36bf-4939-baf8-9602551bad52 could not be found. Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97bafe22-36bf-4939-baf8-9602551bad52 could not be found. Apr 12 10:59:39 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 10:59:39 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ca04e325-40e6-46eb-9830-84e0c8ea5197 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Returning 404 to user: Instance 97bafe22-36bf-4939-baf8-9602551bad52 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 10:59:39 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-ca04e325-40e6-46eb-9830-84e0c8ea5197 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97bafe22-36bf-4939-baf8-9602551bad52" status: 404 len: 111 microversion: 2.1 time: 0.139658 Apr 12 10:59:39 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 334/1017] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:59:39 2023] GET /compute/v2.1/servers/97bafe22-36bf-4939-baf8-9602551bad52 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 10:59:39 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:59:39 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:59:39 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:59:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:39 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 10:59:40 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48" status: 204 len: 0 microversion: 2.1 time: 0.115264 Apr 12 10:59:40 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 339/1018] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 10:59:39 2023] DELETE /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 10:59:40 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-79b8d800-9838-42ab-ab01-a341dcb80f6b tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 10:59:40 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-79b8d800-9838-42ab-ab01-a341dcb80f6b tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 10:59:40 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:59:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-79b8d800-9838-42ab-ab01-a341dcb80f6b tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-79b8d800-9838-42ab-ab01-a341dcb80f6b tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-79b8d800-9838-42ab-ab01-a341dcb80f6b tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-79b8d800-9838-42ab-ab01-a341dcb80f6b tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-79b8d800-9838-42ab-ab01-a341dcb80f6b tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:40 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-79b8d800-9838-42ab-ab01-a341dcb80f6b tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:40 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:59:40 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-79b8d800-9838-42ab-ab01-a341dcb80f6b tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 10:59:40 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-79b8d800-9838-42ab-ab01-a341dcb80f6b tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48" status: 200 len: 1510 microversion: 2.1 time: 0.213483 Apr 12 10:59:40 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 346/1019] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 10:59:40 2023] GET /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48 => generated 1510 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 10:59:40 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-3bdabee0-c37f-4188-adf7-6cbb76480f7c req-551d1718-94f6-46ea-932c-1ad5f4fb32ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3f67e5-420d-42a2-b68a-7cadff22fa48", "name": "network-vif-unplugged", "status": "completed", "tag": "943dbed4-3180-4221-b27c-710c0118b7cf"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:59:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3bdabee0-c37f-4188-adf7-6cbb76480f7c req-551d1718-94f6-46ea-932c-1ad5f4fb32ad service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3bdabee0-c37f-4188-adf7-6cbb76480f7c req-551d1718-94f6-46ea-932c-1ad5f4fb32ad service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:40 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-3bdabee0-c37f-4188-adf7-6cbb76480f7c req-551d1718-94f6-46ea-932c-1ad5f4fb32ad service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-3bdabee0-c37f-4188-adf7-6cbb76480f7c req-551d1718-94f6-46ea-932c-1ad5f4fb32ad service nova] Creating event network-vif-unplugged:943dbed4-3180-4221-b27c-710c0118b7cf for instance be3f67e5-420d-42a2-b68a-7cadff22fa48 on user Apr 12 10:59:40 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-3bdabee0-c37f-4188-adf7-6cbb76480f7c req-551d1718-94f6-46ea-932c-1ad5f4fb32ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035847 Apr 12 10:59:40 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 335/1020] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:59:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:59:41 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-dece4af9-1ab0-471c-b558-8336096bc966 req-b80c1db4-e63a-40b8-9da7-3cc4e9dc6539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3f67e5-420d-42a2-b68a-7cadff22fa48", "name": "network-vif-deleted", "tag": "943dbed4-3180-4221-b27c-710c0118b7cf"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:59:41 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 10:59:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-dece4af9-1ab0-471c-b558-8336096bc966 req-b80c1db4-e63a-40b8-9da7-3cc4e9dc6539 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-dece4af9-1ab0-471c-b558-8336096bc966 req-b80c1db4-e63a-40b8-9da7-3cc4e9dc6539 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:41 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-dece4af9-1ab0-471c-b558-8336096bc966 req-b80c1db4-e63a-40b8-9da7-3cc4e9dc6539 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:41 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-dece4af9-1ab0-471c-b558-8336096bc966 req-b80c1db4-e63a-40b8-9da7-3cc4e9dc6539 service nova] Creating event network-vif-deleted:943dbed4-3180-4221-b27c-710c0118b7cf for instance be3f67e5-420d-42a2-b68a-7cadff22fa48 on user Apr 12 10:59:41 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-dece4af9-1ab0-471c-b558-8336096bc966 req-b80c1db4-e63a-40b8-9da7-3cc4e9dc6539 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031234 Apr 12 10:59:41 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 340/1021] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:59:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 10:59:42 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3f67e5-420d-42a2-b68a-7cadff22fa48", "name": "network-vif-plugged", "status": "completed", "tag": "943dbed4-3180-4221-b27c-710c0118b7cf"}, {"server_uuid": "948c893b-1292-4b9a-8c77-0e23c94387ae", "name": "network-vif-plugged", "status": "completed", "tag": "7c976cd8-54d9-4233-be62-1cecf9cc63c6"}, {"server_uuid": "948c893b-1292-4b9a-8c77-0e23c94387ae", "name": "network-vif-plugged", "status": "completed", "tag": "7c976cd8-54d9-4233-be62-1cecf9cc63c6"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 10:59:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 10:59:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 10:59:42 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 10:59:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] Creating event network-vif-plugged:943dbed4-3180-4221-b27c-710c0118b7cf for instance be3f67e5-420d-42a2-b68a-7cadff22fa48 on user Apr 12 10:59:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] Creating event network-vif-plugged:7c976cd8-54d9-4233-be62-1cecf9cc63c6 for instance 948c893b-1292-4b9a-8c77-0e23c94387ae on user Apr 12 10:59:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] Creating event network-vif-plugged:7c976cd8-54d9-4233-be62-1cecf9cc63c6 for instance 948c893b-1292-4b9a-8c77-0e23c94387ae on user Apr 12 10:59:42 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.033162 Apr 12 10:59:42 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 347/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 10:59:42 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:00:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-89b3ea62-521d-4fe3-8351-073f269e9ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:00:01 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-89b3ea62-521d-4fe3-8351-073f269e9ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:00:01 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:00:01 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:00:01 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:00:01 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=12 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:00:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-89b3ea62-521d-4fe3-8351-073f269e9ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-89b3ea62-521d-4fe3-8351-073f269e9ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-89b3ea62-521d-4fe3-8351-073f269e9ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-89b3ea62-521d-4fe3-8351-073f269e9ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-89b3ea62-521d-4fe3-8351-073f269e9ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-89b3ea62-521d-4fe3-8351-073f269e9ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-89b3ea62-521d-4fe3-8351-073f269e9ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] HTTP exception thrown: Instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 could not be found. Apr 12 11:00:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-89b3ea62-521d-4fe3-8351-073f269e9ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Request method failure captured: Apr 12 11:00:01 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 HTTP/1.1 Apr 12 11:00:01 user devstack@n-api.service[61853]: Accept: application/json Apr 12 11:00:01 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 11:00:01 user devstack@n-api.service[61853]: Connection: close Apr 12 11:00:01 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 11:00:01 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 11:00:01 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 11:00:01 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 11:00:01 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 11:00:01 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNolnZNzT2ThxhSuriBvxuvzWZTym4AlaZYFeuKEGLDsI4JQU5J5EPdqePhYq7aD0VLU4aPMYtUubtPCx4cTyFqrT8VJO6mTH-GETo4CcBCG0ZBRUEmmG4Xqag9VuceySJFT8Zl4MMu3msZfldyluyIaplQmRePuPI9QT24i1FtyI7ZE Apr 12 11:00:01 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 11:00:01 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 11:00:01 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 11:00:01 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 11:00:01 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 11:00:01 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 11:00:01 user devstack@n-api.service[61853]: X-Project-Id: 32235c67d269474b879a58269c1bfb28 Apr 12 11:00:01 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServerActionsTestJSON-2042231427 Apr 12 11:00:01 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 11:00:01 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 11:00:01 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/32235c67d269474b879a58269c1bfb28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32235c67d269474b879a58269c1bfb28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32235c67d269474b879a58269c1bfb28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:00:01 user devstack@n-api.service[61853]: X-Tenant: tempest-ServerActionsTestJSON-2042231427 Apr 12 11:00:01 user devstack@n-api.service[61853]: X-Tenant-Id: 32235c67d269474b879a58269c1bfb28 Apr 12 11:00:01 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServerActionsTestJSON-2042231427 Apr 12 11:00:01 user devstack@n-api.service[61853]: X-User: tempest-ServerActionsTestJSON-2042231427-project-member Apr 12 11:00:01 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 11:00:01 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 11:00:01 user devstack@n-api.service[61853]: X-User-Id: 0059d31539304ffcb5214b408751cd4f Apr 12 11:00:01 user devstack@n-api.service[61853]: X-User-Name: tempest-ServerActionsTestJSON-2042231427-project-member Apr 12 11:00:01 user devstack@n-api.service[61853]: method: > Apr 12 11:00:01 user devstack@n-api.service[61853]: exception: Instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 could not be found. Apr 12 11:00:01 user devstack@n-api.service[61853]: action_args: {'id': 'a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23'} Apr 12 11:00:01 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 could not be found. Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 could not be found. Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 could not be found. Apr 12 11:00:01 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:00:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-89b3ea62-521d-4fe3-8351-073f269e9ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Returning 404 to user: Instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:00:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-89b3ea62-521d-4fe3-8351-073f269e9ea2 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" status: 404 len: 111 microversion: 2.1 time: 0.037730 Apr 12 11:00:01 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 336/1023] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:00:01 2023] GET /compute/v2.1/servers/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 11:00:06 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:00:06 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:00:06 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:00:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-62ab2ac0-4297-4fc1-aaaa-bc52ab86cfcb tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:00:06 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-62ab2ac0-4297-4fc1-aaaa-bc52ab86cfcb tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:00:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-62ab2ac0-4297-4fc1-aaaa-bc52ab86cfcb tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-62ab2ac0-4297-4fc1-aaaa-bc52ab86cfcb tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-62ab2ac0-4297-4fc1-aaaa-bc52ab86cfcb tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-62ab2ac0-4297-4fc1-aaaa-bc52ab86cfcb tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-62ab2ac0-4297-4fc1-aaaa-bc52ab86cfcb tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:06 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-62ab2ac0-4297-4fc1-aaaa-bc52ab86cfcb tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:06 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-62ab2ac0-4297-4fc1-aaaa-bc52ab86cfcb tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] HTTP exception thrown: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 11:00:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-62ab2ac0-4297-4fc1-aaaa-bc52ab86cfcb tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Request method failure captured: Apr 12 11:00:06 user devstack@n-api.service[61852]: request: DELETE /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b HTTP/1.1 Apr 12 11:00:06 user devstack@n-api.service[61852]: Accept: application/json Apr 12 11:00:06 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 11:00:06 user devstack@n-api.service[61852]: Connection: close Apr 12 11:00:06 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 11:00:06 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 11:00:06 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 11:00:06 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 11:00:06 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 11:00:06 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNolnZNzT2ThxhSuriBvxuvzWZTym4AlaZYFeuKEGLDsI4JQU5J5EPdqePhYq7aD0VLU4aPMYtUubtPCx4cTyFqrT8VJO6mTH-GETo4CcBCG0ZBRUEmmG4Xqag9VuceySJFT8Zl4MMu3msZfldyluyIaplQmRePuPI9QT24i1FtyI7ZE Apr 12 11:00:06 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 11:00:06 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 11:00:06 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 11:00:06 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 11:00:06 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 11:00:06 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 11:00:06 user devstack@n-api.service[61852]: X-Project-Id: 32235c67d269474b879a58269c1bfb28 Apr 12 11:00:06 user devstack@n-api.service[61852]: X-Project-Name: tempest-ServerActionsTestJSON-2042231427 Apr 12 11:00:06 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 11:00:06 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 11:00:06 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/32235c67d269474b879a58269c1bfb28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32235c67d269474b879a58269c1bfb28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32235c67d269474b879a58269c1bfb28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:00:06 user devstack@n-api.service[61852]: X-Tenant: tempest-ServerActionsTestJSON-2042231427 Apr 12 11:00:06 user devstack@n-api.service[61852]: X-Tenant-Id: 32235c67d269474b879a58269c1bfb28 Apr 12 11:00:06 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-ServerActionsTestJSON-2042231427 Apr 12 11:00:06 user devstack@n-api.service[61852]: X-User: tempest-ServerActionsTestJSON-2042231427-project-member Apr 12 11:00:06 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 11:00:06 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 11:00:06 user devstack@n-api.service[61852]: X-User-Id: 0059d31539304ffcb5214b408751cd4f Apr 12 11:00:06 user devstack@n-api.service[61852]: X-User-Name: tempest-ServerActionsTestJSON-2042231427-project-member Apr 12 11:00:06 user devstack@n-api.service[61852]: method: > Apr 12 11:00:06 user devstack@n-api.service[61852]: exception: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 11:00:06 user devstack@n-api.service[61852]: action_args: {'id': 'bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b'} Apr 12 11:00:06 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 11:00:06 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:00:06 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-62ab2ac0-4297-4fc1-aaaa-bc52ab86cfcb tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Returning 404 to user: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:00:06 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-62ab2ac0-4297-4fc1-aaaa-bc52ab86cfcb tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 404 len: 111 microversion: 2.1 time: 0.051228 Apr 12 11:00:06 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 341/1024] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 11:00:06 2023] DELETE /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 11:00:06 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:00:06 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=7 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:00:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-dfd01de0-7800-440a-9319-365873e965cd tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:00:06 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-dfd01de0-7800-440a-9319-365873e965cd tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:00:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-dfd01de0-7800-440a-9319-365873e965cd tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-dfd01de0-7800-440a-9319-365873e965cd tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-dfd01de0-7800-440a-9319-365873e965cd tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-dfd01de0-7800-440a-9319-365873e965cd tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-dfd01de0-7800-440a-9319-365873e965cd tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:06 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-dfd01de0-7800-440a-9319-365873e965cd tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-dfd01de0-7800-440a-9319-365873e965cd tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] HTTP exception thrown: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 11:00:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-dfd01de0-7800-440a-9319-365873e965cd tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Request method failure captured: Apr 12 11:00:06 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b HTTP/1.1 Apr 12 11:00:06 user devstack@n-api.service[61854]: Accept: application/json Apr 12 11:00:06 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 11:00:06 user devstack@n-api.service[61854]: Connection: close Apr 12 11:00:06 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 11:00:06 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 11:00:06 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 11:00:06 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 11:00:06 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 11:00:06 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNolnZNzT2ThxhSuriBvxuvzWZTym4AlaZYFeuKEGLDsI4JQU5J5EPdqePhYq7aD0VLU4aPMYtUubtPCx4cTyFqrT8VJO6mTH-GETo4CcBCG0ZBRUEmmG4Xqag9VuceySJFT8Zl4MMu3msZfldyluyIaplQmRePuPI9QT24i1FtyI7ZE Apr 12 11:00:06 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 11:00:06 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 11:00:06 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 11:00:06 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 11:00:06 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 11:00:06 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 11:00:06 user devstack@n-api.service[61854]: X-Project-Id: 32235c67d269474b879a58269c1bfb28 Apr 12 11:00:06 user devstack@n-api.service[61854]: X-Project-Name: tempest-ServerActionsTestJSON-2042231427 Apr 12 11:00:06 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 11:00:06 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 11:00:06 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/32235c67d269474b879a58269c1bfb28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32235c67d269474b879a58269c1bfb28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32235c67d269474b879a58269c1bfb28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:00:06 user devstack@n-api.service[61854]: X-Tenant: tempest-ServerActionsTestJSON-2042231427 Apr 12 11:00:06 user devstack@n-api.service[61854]: X-Tenant-Id: 32235c67d269474b879a58269c1bfb28 Apr 12 11:00:06 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-ServerActionsTestJSON-2042231427 Apr 12 11:00:06 user devstack@n-api.service[61854]: X-User: tempest-ServerActionsTestJSON-2042231427-project-member Apr 12 11:00:06 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 11:00:06 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 11:00:06 user devstack@n-api.service[61854]: X-User-Id: 0059d31539304ffcb5214b408751cd4f Apr 12 11:00:06 user devstack@n-api.service[61854]: X-User-Name: tempest-ServerActionsTestJSON-2042231427-project-member Apr 12 11:00:06 user devstack@n-api.service[61854]: method: > Apr 12 11:00:06 user devstack@n-api.service[61854]: exception: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 11:00:06 user devstack@n-api.service[61854]: action_args: {'id': 'bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b'} Apr 12 11:00:06 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. Apr 12 11:00:06 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:00:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-dfd01de0-7800-440a-9319-365873e965cd tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Returning 404 to user: Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:00:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-dfd01de0-7800-440a-9319-365873e965cd tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" status: 404 len: 111 microversion: 2.1 time: 0.037398 Apr 12 11:00:06 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 348/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:00:06 2023] GET /compute/v2.1/servers/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 11:00:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-3643e8ac-ef7d-45c2-9e62-ed173f9ac149 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Calling method '.version_select at 0x7fabbfa2d510>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:00:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-3643e8ac-ef7d-45c2-9e62-ed173f9ac149 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241183546" status: 202 len: 0 microversion: 2.1 time: 0.026198 Apr 12 11:00:06 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 337/1026] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 11:00:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241183546 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 11:00:08 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-0f6d57d4-97b6-4dc0-97d2-efea59135a4b tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:00:08 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-0f6d57d4-97b6-4dc0-97d2-efea59135a4b tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:00:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0f6d57d4-97b6-4dc0-97d2-efea59135a4b tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0f6d57d4-97b6-4dc0-97d2-efea59135a4b tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0f6d57d4-97b6-4dc0-97d2-efea59135a4b tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0f6d57d4-97b6-4dc0-97d2-efea59135a4b tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0f6d57d4-97b6-4dc0-97d2-efea59135a4b tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0f6d57d4-97b6-4dc0-97d2-efea59135a4b tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:08 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-0f6d57d4-97b6-4dc0-97d2-efea59135a4b tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066081 Apr 12 11:00:08 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 342/1027] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 11:00:08 2023] GET /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 11:00:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-395754952"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:00:11 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:00:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "POST /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6/action" status: 202 len: 0 microversion: 2.1 time: 0.904926 Apr 12 11:00:12 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 349/1028] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 11:00:11 2023] POST /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6/action => generated 0 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 11:00:12 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:00:12 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-9799ebee-5780-4d55-8fad-068f91b913ba tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:00:12 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-9799ebee-5780-4d55-8fad-068f91b913ba tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:00:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9799ebee-5780-4d55-8fad-068f91b913ba tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9799ebee-5780-4d55-8fad-068f91b913ba tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9799ebee-5780-4d55-8fad-068f91b913ba tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9799ebee-5780-4d55-8fad-068f91b913ba tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9799ebee-5780-4d55-8fad-068f91b913ba tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-9799ebee-5780-4d55-8fad-068f91b913ba tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:12 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-9799ebee-5780-4d55-8fad-068f91b913ba tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325a0abaf7b6485ca97e2d2af2bc9778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7541fb4f462b438dbef4ffe9be4725b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:00:12 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-9799ebee-5780-4d55-8fad-068f91b913ba tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87" status: 200 len: 1568 microversion: 2.1 time: 0.170766 Apr 12 11:00:12 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 338/1029] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:00:12 2023] GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:00:15 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-db4f8660-5e7d-4bf5-a8e8-7febbf36035d req-e3799251-b489-4be4-85c8-b2623dfb4336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca545a0c-89fd-4a04-9d87-c2698051ca87", "tag": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:00:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-db4f8660-5e7d-4bf5-a8e8-7febbf36035d req-e3799251-b489-4be4-85c8-b2623dfb4336 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-db4f8660-5e7d-4bf5-a8e8-7febbf36035d req-e3799251-b489-4be4-85c8-b2623dfb4336 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-db4f8660-5e7d-4bf5-a8e8-7febbf36035d req-e3799251-b489-4be4-85c8-b2623dfb4336 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-db4f8660-5e7d-4bf5-a8e8-7febbf36035d req-e3799251-b489-4be4-85c8-b2623dfb4336 service nova] Creating event network-changed:4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 for instance ca545a0c-89fd-4a04-9d87-c2698051ca87 on user Apr 12 11:00:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-db4f8660-5e7d-4bf5-a8e8-7febbf36035d req-e3799251-b489-4be4-85c8-b2623dfb4336 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033218 Apr 12 11:00:15 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 343/1030] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:00:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:00:15 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "135f653f-dd8f-429b-8d7a-d8830a8d0bfb"}} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:00:15 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:00:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287340 Apr 12 11:00:16 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 350/1031] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 11:00:15 2023] POST /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:00:20 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1353198364", "imageRef": "7c91e395-34dd-4893-b9af-62553efd7311", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1731935486", "security_groups": [{"name": "tempest-secgroup-smoke-1233307456"}], "networks": [{"uuid": "b1da98cc-b18c-477c-9e03-df8190b944d1"}]}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:00:20 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] validate_networks() for [('b1da98cc-b18c-477c-9e03-df8190b944d1', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 11:00:20 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 11:00:20 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 11:00:20 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 11:00:20 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 11:00:20 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 11:00:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:20 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Getting quotas for project 4a0f2b52a1a04769803c3a44a924ff00. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 11:00:20 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Getting quotas for user aed741675f5944f1882c097c411437f6 and project 4a0f2b52a1a04769803c3a44a924ff00. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 11:00:20 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 11:00:20 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c91e395-34dd-4893-b9af-62553efd7311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 11:00:20 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.676668 Apr 12 11:00:20 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 339/1032] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 11:00:20 2023] POST /compute/v2.1/servers => generated 404 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 11:00:20 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-8cc1ac8e-4840-4c20-9423-149db7da7cc1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:00:20 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-8cc1ac8e-4840-4c20-9423-149db7da7cc1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:00:20 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-8cc1ac8e-4840-4c20-9423-149db7da7cc1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed741675f5944f1882c097c411437f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0f2b52a1a04769803c3a44a924ff00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:00:20 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-8cc1ac8e-4840-4c20-9423-149db7da7cc1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0" status: 200 len: 1237 microversion: 2.1 time: 0.072176 Apr 12 11:00:20 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 344/1033] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:00:20 2023] GET /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:00:21 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7e63a734-e46c-493a-b182-00cd7c702c00 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:00:21 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-7e63a734-e46c-493a-b182-00cd7c702c00 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:00:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7e63a734-e46c-493a-b182-00cd7c702c00 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7e63a734-e46c-493a-b182-00cd7c702c00 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7e63a734-e46c-493a-b182-00cd7c702c00 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7e63a734-e46c-493a-b182-00cd7c702c00 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7e63a734-e46c-493a-b182-00cd7c702c00 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-7e63a734-e46c-493a-b182-00cd7c702c00 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:22 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-7e63a734-e46c-493a-b182-00cd7c702c00 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:00:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-7e63a734-e46c-493a-b182-00cd7c702c00 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/948c893b-1292-4b9a-8c77-0e23c94387ae" status: 200 len: 1441 microversion: 2.1 time: 0.183132 Apr 12 11:00:22 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 351/1034] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:00:21 2023] GET /compute/v2.1/servers/948c893b-1292-4b9a-8c77-0e23c94387ae => generated 1441 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:00:23 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-b16f6a1f-33f7-493a-a23a-a09b1f655509 req-880006e5-03b5-48a1-b848-9e2bf7560335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec82dbf-d946-4aca-9320-8fd0c197e1c0", "tag": "619a1e09-7376-4439-a5bb-72a26f4865ad"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:00:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b16f6a1f-33f7-493a-a23a-a09b1f655509 req-880006e5-03b5-48a1-b848-9e2bf7560335 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b16f6a1f-33f7-493a-a23a-a09b1f655509 req-880006e5-03b5-48a1-b848-9e2bf7560335 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:23 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-b16f6a1f-33f7-493a-a23a-a09b1f655509 req-880006e5-03b5-48a1-b848-9e2bf7560335 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-b16f6a1f-33f7-493a-a23a-a09b1f655509 req-880006e5-03b5-48a1-b848-9e2bf7560335 service nova] Creating event network-changed:619a1e09-7376-4439-a5bb-72a26f4865ad for instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 on user Apr 12 11:00:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-b16f6a1f-33f7-493a-a23a-a09b1f655509 req-880006e5-03b5-48a1-b848-9e2bf7560335 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032287 Apr 12 11:00:23 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 340/1035] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:00:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:00:24 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:00:24 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:24 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:24 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:24 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Going to try to start instance {{(pid=61852) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 12 11:00:24 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644/action" status: 202 len: 0 microversion: 2.1 time: 0.241136 Apr 12 11:00:24 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 345/1036] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 11:00:24 2023] POST /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 11:00:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-c4b02831-b4ba-45fa-a2e9-362a28e57837 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:00:24 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-c4b02831-b4ba-45fa-a2e9-362a28e57837 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:00:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c4b02831-b4ba-45fa-a2e9-362a28e57837 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c4b02831-b4ba-45fa-a2e9-362a28e57837 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c4b02831-b4ba-45fa-a2e9-362a28e57837 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c4b02831-b4ba-45fa-a2e9-362a28e57837 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c4b02831-b4ba-45fa-a2e9-362a28e57837 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c4b02831-b4ba-45fa-a2e9-362a28e57837 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:24 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-c4b02831-b4ba-45fa-a2e9-362a28e57837 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6576467073e41e9b497097d5a8dfd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9878bfe34ceb4a6695b253ad161c4f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:00:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-c4b02831-b4ba-45fa-a2e9-362a28e57837 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644" status: 200 len: 1652 microversion: 2.1 time: 0.336653 Apr 12 11:00:24 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 352/1037] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:00:24 2023] GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644 => generated 1652 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:00:27 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-0af2c90e-2c69-4811-934c-f245e9623ba4 req-4e65dc7b-b10f-46d7-bf56-4c28c106c357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec82dbf-d946-4aca-9320-8fd0c197e1c0", "name": "network-vif-plugged", "status": "completed", "tag": "619a1e09-7376-4439-a5bb-72a26f4865ad"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:00:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0af2c90e-2c69-4811-934c-f245e9623ba4 req-4e65dc7b-b10f-46d7-bf56-4c28c106c357 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0af2c90e-2c69-4811-934c-f245e9623ba4 req-4e65dc7b-b10f-46d7-bf56-4c28c106c357 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-0af2c90e-2c69-4811-934c-f245e9623ba4 req-4e65dc7b-b10f-46d7-bf56-4c28c106c357 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:27 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-0af2c90e-2c69-4811-934c-f245e9623ba4 req-4e65dc7b-b10f-46d7-bf56-4c28c106c357 service nova] Creating event network-vif-plugged:619a1e09-7376-4439-a5bb-72a26f4865ad for instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 on user Apr 12 11:00:27 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-0af2c90e-2c69-4811-934c-f245e9623ba4 req-4e65dc7b-b10f-46d7-bf56-4c28c106c357 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039047 Apr 12 11:00:27 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 341/1038] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:00:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:00:28 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-38b62fb1-8d6c-464b-b7e2-9d80b0072259 req-55d1149f-bdb2-4670-9bc7-ebe40e8c09ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aef35e7-5daf-4d41-b91b-a7ff4a481644", "name": "network-vif-plugged", "status": "completed", "tag": "8786a087-f036-403b-9b82-c75fc6dbb110"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:00:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-38b62fb1-8d6c-464b-b7e2-9d80b0072259 req-55d1149f-bdb2-4670-9bc7-ebe40e8c09ed service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-38b62fb1-8d6c-464b-b7e2-9d80b0072259 req-55d1149f-bdb2-4670-9bc7-ebe40e8c09ed service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-38b62fb1-8d6c-464b-b7e2-9d80b0072259 req-55d1149f-bdb2-4670-9bc7-ebe40e8c09ed service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:28 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-38b62fb1-8d6c-464b-b7e2-9d80b0072259 req-55d1149f-bdb2-4670-9bc7-ebe40e8c09ed service nova] Creating event network-vif-plugged:8786a087-f036-403b-9b82-c75fc6dbb110 for instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 on user Apr 12 11:00:28 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-38b62fb1-8d6c-464b-b7e2-9d80b0072259 req-55d1149f-bdb2-4670-9bc7-ebe40e8c09ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031013 Apr 12 11:00:28 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 346/1039] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:00:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:00:29 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-7f9e6524-14e5-436b-9b06-70608056b6da req-22388cd0-6df0-4be1-9847-df9e963191b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec82dbf-d946-4aca-9320-8fd0c197e1c0", "name": "network-vif-plugged", "status": "completed", "tag": "619a1e09-7376-4439-a5bb-72a26f4865ad"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:00:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7f9e6524-14e5-436b-9b06-70608056b6da req-22388cd0-6df0-4be1-9847-df9e963191b1 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7f9e6524-14e5-436b-9b06-70608056b6da req-22388cd0-6df0-4be1-9847-df9e963191b1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:29 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7f9e6524-14e5-436b-9b06-70608056b6da req-22388cd0-6df0-4be1-9847-df9e963191b1 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-7f9e6524-14e5-436b-9b06-70608056b6da req-22388cd0-6df0-4be1-9847-df9e963191b1 service nova] Creating event network-vif-plugged:619a1e09-7376-4439-a5bb-72a26f4865ad for instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 on user Apr 12 11:00:29 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-7f9e6524-14e5-436b-9b06-70608056b6da req-22388cd0-6df0-4be1-9847-df9e963191b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042632 Apr 12 11:00:29 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 353/1040] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:00:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:00:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8226cc8e-c651-4206-9d32-d0d1aed2bbde tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:00:30 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-8226cc8e-c651-4206-9d32-d0d1aed2bbde tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:00:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8226cc8e-c651-4206-9d32-d0d1aed2bbde tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8226cc8e-c651-4206-9d32-d0d1aed2bbde tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8226cc8e-c651-4206-9d32-d0d1aed2bbde tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8226cc8e-c651-4206-9d32-d0d1aed2bbde tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8226cc8e-c651-4206-9d32-d0d1aed2bbde tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-8226cc8e-c651-4206-9d32-d0d1aed2bbde tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-8226cc8e-c651-4206-9d32-d0d1aed2bbde tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] HTTP exception thrown: Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 could not be found. Apr 12 11:00:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8226cc8e-c651-4206-9d32-d0d1aed2bbde tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Request method failure captured: Apr 12 11:00:30 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48 HTTP/1.1 Apr 12 11:00:30 user devstack@n-api.service[61853]: Accept: application/json Apr 12 11:00:30 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 11:00:30 user devstack@n-api.service[61853]: Connection: close Apr 12 11:00:30 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 11:00:30 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 11:00:30 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 11:00:30 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 11:00:30 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 11:00:30 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNosqGCy9LHgGo-Yndp_Ix86dPoADuTrnm_RImsbY43eqA9xWhvyiivJnioJ9z9p3RlxFBVMsvx400Bp1v_lrKGOZVyQ8-QQERpwxm8kerR5X4hr_sxNED11I87boYZJQ5SrrIjm9pfsA1H5fYaQPT7mBTJHETLyCcAwgOQ0Bd95rMsc Apr 12 11:00:30 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 11:00:30 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 11:00:30 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 11:00:30 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 11:00:30 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 11:00:30 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 11:00:30 user devstack@n-api.service[61853]: X-Project-Id: 2b39cd8e55b54a86a7784f2934273e20 Apr 12 11:00:30 user devstack@n-api.service[61853]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1632398833 Apr 12 11:00:30 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 11:00:30 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 11:00:30 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2b39cd8e55b54a86a7784f2934273e20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b39cd8e55b54a86a7784f2934273e20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b39cd8e55b54a86a7784f2934273e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:00:30 user devstack@n-api.service[61853]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1632398833 Apr 12 11:00:30 user devstack@n-api.service[61853]: X-Tenant-Id: 2b39cd8e55b54a86a7784f2934273e20 Apr 12 11:00:30 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1632398833 Apr 12 11:00:30 user devstack@n-api.service[61853]: X-User: tempest-ServerRescueNegativeTestJSON-1632398833-project-member Apr 12 11:00:30 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 11:00:30 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 11:00:30 user devstack@n-api.service[61853]: X-User-Id: abdf772f2c7341c29159b6f1f2ce7ccb Apr 12 11:00:30 user devstack@n-api.service[61853]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1632398833-project-member Apr 12 11:00:30 user devstack@n-api.service[61853]: method: > Apr 12 11:00:30 user devstack@n-api.service[61853]: exception: Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 could not be found. Apr 12 11:00:30 user devstack@n-api.service[61853]: action_args: {'id': 'be3f67e5-420d-42a2-b68a-7cadff22fa48'} Apr 12 11:00:30 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 could not be found. Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 could not be found. Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 could not be found. Apr 12 11:00:30 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:00:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8226cc8e-c651-4206-9d32-d0d1aed2bbde tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Returning 404 to user: Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:00:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8226cc8e-c651-4206-9d32-d0d1aed2bbde tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48" status: 404 len: 111 microversion: 2.1 time: 0.034059 Apr 12 11:00:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 342/1041] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:00:30 2023] GET /compute/v2.1/servers/be3f67e5-420d-42a2-b68a-7cadff22fa48 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 11:00:30 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-d19e249e-9a88-48b7-923c-b75fb34b386c req-c046b93a-805a-4502-a671-3d04ddac08c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aef35e7-5daf-4d41-b91b-a7ff4a481644", "name": "network-vif-plugged", "status": "completed", "tag": "8786a087-f036-403b-9b82-c75fc6dbb110"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:00:30 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d19e249e-9a88-48b7-923c-b75fb34b386c req-c046b93a-805a-4502-a671-3d04ddac08c5 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:30 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d19e249e-9a88-48b7-923c-b75fb34b386c req-c046b93a-805a-4502-a671-3d04ddac08c5 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:30 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d19e249e-9a88-48b7-923c-b75fb34b386c req-c046b93a-805a-4502-a671-3d04ddac08c5 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:30 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-d19e249e-9a88-48b7-923c-b75fb34b386c req-c046b93a-805a-4502-a671-3d04ddac08c5 service nova] Creating event network-vif-plugged:8786a087-f036-403b-9b82-c75fc6dbb110 for instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 on user Apr 12 11:00:30 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-d19e249e-9a88-48b7-923c-b75fb34b386c req-c046b93a-805a-4502-a671-3d04ddac08c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042930 Apr 12 11:00:30 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 347/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:00:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:00:33 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:00:33 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:00:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:33 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:33 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'services' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 11:00:33 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments/135f653f-dd8f-429b-8d7a-d8830a8d0bfb" status: 202 len: 0 microversion: 2.1 time: 0.210663 Apr 12 11:00:33 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 354/1043] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 11:00:33 2023] DELETE /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments/135f653f-dd8f-429b-8d7a-d8830a8d0bfb => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 11:00:33 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-bbbea067-a41a-4a52-9b8b-fa36940ba7da tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:00:33 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-bbbea067-a41a-4a52-9b8b-fa36940ba7da tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:00:33 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:00:33 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:00:33 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:00:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bbbea067-a41a-4a52-9b8b-fa36940ba7da tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bbbea067-a41a-4a52-9b8b-fa36940ba7da tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bbbea067-a41a-4a52-9b8b-fa36940ba7da tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bbbea067-a41a-4a52-9b8b-fa36940ba7da tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:00:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bbbea067-a41a-4a52-9b8b-fa36940ba7da tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:00:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bbbea067-a41a-4a52-9b8b-fa36940ba7da tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:00:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-bbbea067-a41a-4a52-9b8b-fa36940ba7da tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067302 Apr 12 11:00:34 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 343/1044] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 11:00:33 2023] GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:01:10 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:01:10 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=16 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:01:10 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:01:10 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-9b56320f-4f08-4e1c-964d-f5d87307f026 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:01:10 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-9b56320f-4f08-4e1c-964d-f5d87307f026 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:01:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9b56320f-4f08-4e1c-964d-f5d87307f026 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9b56320f-4f08-4e1c-964d-f5d87307f026 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9b56320f-4f08-4e1c-964d-f5d87307f026 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9b56320f-4f08-4e1c-964d-f5d87307f026 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9b56320f-4f08-4e1c-964d-f5d87307f026 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-9b56320f-4f08-4e1c-964d-f5d87307f026 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:11 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-9b56320f-4f08-4e1c-964d-f5d87307f026 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed741675f5944f1882c097c411437f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0f2b52a1a04769803c3a44a924ff00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:01:11 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-9b56320f-4f08-4e1c-964d-f5d87307f026 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0" status: 200 len: 1539 microversion: 2.1 time: 0.351782 Apr 12 11:01:11 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 348/1045] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:01:10 2023] GET /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0 => generated 1539 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:01:14 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=14 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:01:14 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:01:14 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-9d70c127-3ac6-4bba-aa0e-4619c3769f50 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:01:14 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-9d70c127-3ac6-4bba-aa0e-4619c3769f50 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:01:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9d70c127-3ac6-4bba-aa0e-4619c3769f50 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9d70c127-3ac6-4bba-aa0e-4619c3769f50 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9d70c127-3ac6-4bba-aa0e-4619c3769f50 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9d70c127-3ac6-4bba-aa0e-4619c3769f50 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9d70c127-3ac6-4bba-aa0e-4619c3769f50 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:14 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-9d70c127-3ac6-4bba-aa0e-4619c3769f50 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:15 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-9d70c127-3ac6-4bba-aa0e-4619c3769f50 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6576467073e41e9b497097d5a8dfd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9878bfe34ceb4a6695b253ad161c4f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:01:15 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-9d70c127-3ac6-4bba-aa0e-4619c3769f50 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644" status: 200 len: 1656 microversion: 2.1 time: 0.399396 Apr 12 11:01:15 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 355/1046] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:01:14 2023] GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644 => generated 1656 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:01:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d8b6589b-8065-4088-a4ca-1a5b54aececd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:01:22 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d8b6589b-8065-4088-a4ca-1a5b54aececd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:01:22 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:01:22 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=20 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:01:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d8b6589b-8065-4088-a4ca-1a5b54aececd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d8b6589b-8065-4088-a4ca-1a5b54aececd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d8b6589b-8065-4088-a4ca-1a5b54aececd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d8b6589b-8065-4088-a4ca-1a5b54aececd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d8b6589b-8065-4088-a4ca-1a5b54aececd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d8b6589b-8065-4088-a4ca-1a5b54aececd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:22 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-d8b6589b-8065-4088-a4ca-1a5b54aececd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:01:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-d8b6589b-8065-4088-a4ca-1a5b54aececd tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/948c893b-1292-4b9a-8c77-0e23c94387ae" status: 200 len: 1441 microversion: 2.1 time: 0.185496 Apr 12 11:01:22 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 344/1047] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:01:22 2023] GET /compute/v2.1/servers/948c893b-1292-4b9a-8c77-0e23c94387ae => generated 1441 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:01:24 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-aff62e2a-e5ff-4092-ac97-fad91e368f17 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:01:24 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-aff62e2a-e5ff-4092-ac97-fad91e368f17 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:01:24 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:01:24 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:01:24 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-aff62e2a-e5ff-4092-ac97-fad91e368f17 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:24 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-aff62e2a-e5ff-4092-ac97-fad91e368f17 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:24 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-aff62e2a-e5ff-4092-ac97-fad91e368f17 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:24 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-aff62e2a-e5ff-4092-ac97-fad91e368f17 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:24 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-aff62e2a-e5ff-4092-ac97-fad91e368f17 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:24 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-aff62e2a-e5ff-4092-ac97-fad91e368f17 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:24 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-aff62e2a-e5ff-4092-ac97-fad91e368f17 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048067 Apr 12 11:01:24 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 349/1048] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 11:01:24 2023] GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 11:01:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-31b98e25-586f-485c-989b-d5c0e43db849 req-59faeff1-00da-4067-bfd8-2165d1ccc85c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "948c893b-1292-4b9a-8c77-0e23c94387ae", "tag": "7c976cd8-54d9-4233-be62-1cecf9cc63c6"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:01:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-31b98e25-586f-485c-989b-d5c0e43db849 req-59faeff1-00da-4067-bfd8-2165d1ccc85c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-31b98e25-586f-485c-989b-d5c0e43db849 req-59faeff1-00da-4067-bfd8-2165d1ccc85c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-31b98e25-586f-485c-989b-d5c0e43db849 req-59faeff1-00da-4067-bfd8-2165d1ccc85c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-31b98e25-586f-485c-989b-d5c0e43db849 req-59faeff1-00da-4067-bfd8-2165d1ccc85c service nova] Creating event network-changed:7c976cd8-54d9-4233-be62-1cecf9cc63c6 for instance 948c893b-1292-4b9a-8c77-0e23c94387ae on user Apr 12 11:01:24 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-31b98e25-586f-485c-989b-d5c0e43db849 req-59faeff1-00da-4067-bfd8-2165d1ccc85c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033637 Apr 12 11:01:24 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 356/1049] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:01:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:01:25 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:01:25 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:01:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:25 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Going to try to terminate instance {{(pid=61853) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 11:01:25 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/948c893b-1292-4b9a-8c77-0e23c94387ae" status: 204 len: 0 microversion: 2.1 time: 0.219803 Apr 12 11:01:25 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 345/1050] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 11:01:25 2023] DELETE /compute/v2.1/servers/948c893b-1292-4b9a-8c77-0e23c94387ae => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 11:01:25 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-21294561-2d3f-4404-8d91-1f3ca0037d71 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:01:25 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-21294561-2d3f-4404-8d91-1f3ca0037d71 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:01:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-21294561-2d3f-4404-8d91-1f3ca0037d71 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-21294561-2d3f-4404-8d91-1f3ca0037d71 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-21294561-2d3f-4404-8d91-1f3ca0037d71 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-21294561-2d3f-4404-8d91-1f3ca0037d71 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-21294561-2d3f-4404-8d91-1f3ca0037d71 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-21294561-2d3f-4404-8d91-1f3ca0037d71 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:25 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-21294561-2d3f-4404-8d91-1f3ca0037d71 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:01:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-21294561-2d3f-4404-8d91-1f3ca0037d71 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/948c893b-1292-4b9a-8c77-0e23c94387ae" status: 200 len: 1566 microversion: 2.1 time: 0.294914 Apr 12 11:01:25 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 350/1051] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:01:25 2023] GET /compute/v2.1/servers/948c893b-1292-4b9a-8c77-0e23c94387ae => generated 1566 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:01:26 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "948c893b-1292-4b9a-8c77-0e23c94387ae", "tag": "7c976cd8-54d9-4233-be62-1cecf9cc63c6"}, {"server_uuid": "948c893b-1292-4b9a-8c77-0e23c94387ae", "name": "network-vif-unplugged", "status": "completed", "tag": "7c976cd8-54d9-4233-be62-1cecf9cc63c6"}, {"server_uuid": "948c893b-1292-4b9a-8c77-0e23c94387ae", "name": "network-vif-plugged", "status": "completed", "tag": "7c976cd8-54d9-4233-be62-1cecf9cc63c6"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:01:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:26 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] Creating event network-changed:7c976cd8-54d9-4233-be62-1cecf9cc63c6 for instance 948c893b-1292-4b9a-8c77-0e23c94387ae on user Apr 12 11:01:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] Creating event network-vif-unplugged:7c976cd8-54d9-4233-be62-1cecf9cc63c6 for instance 948c893b-1292-4b9a-8c77-0e23c94387ae on user Apr 12 11:01:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] Creating event network-vif-plugged:7c976cd8-54d9-4233-be62-1cecf9cc63c6 for instance 948c893b-1292-4b9a-8c77-0e23c94387ae on user Apr 12 11:01:26 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.038729 Apr 12 11:01:26 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 357/1052] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:01:26 2023] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:01:26 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:01:26 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:01:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:27 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322392 Apr 12 11:01:27 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 346/1053] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 11:01:26 2023] POST /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:01:27 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-9ba893c1-fd16-45d5-a7a3-4d45ce30751d req-678282ac-6f57-4e04-a2ed-f90452a14288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "948c893b-1292-4b9a-8c77-0e23c94387ae", "name": "network-vif-deleted", "tag": "7c976cd8-54d9-4233-be62-1cecf9cc63c6"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:01:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-9ba893c1-fd16-45d5-a7a3-4d45ce30751d req-678282ac-6f57-4e04-a2ed-f90452a14288 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-9ba893c1-fd16-45d5-a7a3-4d45ce30751d req-678282ac-6f57-4e04-a2ed-f90452a14288 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-9ba893c1-fd16-45d5-a7a3-4d45ce30751d req-678282ac-6f57-4e04-a2ed-f90452a14288 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:27 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-9ba893c1-fd16-45d5-a7a3-4d45ce30751d req-678282ac-6f57-4e04-a2ed-f90452a14288 service nova] Creating event network-vif-deleted:7c976cd8-54d9-4233-be62-1cecf9cc63c6 for instance 948c893b-1292-4b9a-8c77-0e23c94387ae on user Apr 12 11:01:27 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-9ba893c1-fd16-45d5-a7a3-4d45ce30751d req-678282ac-6f57-4e04-a2ed-f90452a14288 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042880 Apr 12 11:01:27 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 351/1054] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:01:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:01:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:01:35 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:01:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:35 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'services' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 11:01:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments/21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7" status: 202 len: 0 microversion: 2.1 time: 0.170102 Apr 12 11:01:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 358/1055] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 11:01:35 2023] DELETE /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments/21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 11:01:35 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a5ebce09-4e93-4adc-bacb-469a8c8c7beb tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:01:35 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a5ebce09-4e93-4adc-bacb-469a8c8c7beb tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:01:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a5ebce09-4e93-4adc-bacb-469a8c8c7beb tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a5ebce09-4e93-4adc-bacb-469a8c8c7beb tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a5ebce09-4e93-4adc-bacb-469a8c8c7beb tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a5ebce09-4e93-4adc-bacb-469a8c8c7beb tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:01:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a5ebce09-4e93-4adc-bacb-469a8c8c7beb tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:01:35 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a5ebce09-4e93-4adc-bacb-469a8c8c7beb tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:01:35 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a5ebce09-4e93-4adc-bacb-469a8c8c7beb tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117489 Apr 12 11:01:35 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 347/1056] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 11:01:35 2023] GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:02:11 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:02:11 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=14 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:02:11 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-729acae5-f1a0-44b4-a50e-4dfb81458bb7 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:02:11 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-729acae5-f1a0-44b4-a50e-4dfb81458bb7 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:02:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-729acae5-f1a0-44b4-a50e-4dfb81458bb7 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-729acae5-f1a0-44b4-a50e-4dfb81458bb7 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-729acae5-f1a0-44b4-a50e-4dfb81458bb7 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-729acae5-f1a0-44b4-a50e-4dfb81458bb7 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-729acae5-f1a0-44b4-a50e-4dfb81458bb7 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-729acae5-f1a0-44b4-a50e-4dfb81458bb7 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:11 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-729acae5-f1a0-44b4-a50e-4dfb81458bb7 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed741675f5944f1882c097c411437f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0f2b52a1a04769803c3a44a924ff00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:02:11 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-729acae5-f1a0-44b4-a50e-4dfb81458bb7 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0" status: 200 len: 1539 microversion: 2.1 time: 0.171202 Apr 12 11:02:11 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 352/1057] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:02:11 2023] GET /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0 => generated 1539 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:02:12 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=8 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:02:12 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:02:13 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03d8e234-e7b8-4854-8c8c-3f715bbef045"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:02:13 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:02:13 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:02:13 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:02:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:13 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:13 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-72f643a9-5589-4663-9fe8-c10d9500ae8b req-9b0cbde5-1751-4609-97bb-b34df6259213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec82dbf-d946-4aca-9320-8fd0c197e1c0", "tag": "619a1e09-7376-4439-a5bb-72a26f4865ad"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:02:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-72f643a9-5589-4663-9fe8-c10d9500ae8b req-9b0cbde5-1751-4609-97bb-b34df6259213 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-72f643a9-5589-4663-9fe8-c10d9500ae8b req-9b0cbde5-1751-4609-97bb-b34df6259213 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:13 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-72f643a9-5589-4663-9fe8-c10d9500ae8b req-9b0cbde5-1751-4609-97bb-b34df6259213 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-72f643a9-5589-4663-9fe8-c10d9500ae8b req-9b0cbde5-1751-4609-97bb-b34df6259213 service nova] Creating event network-changed:619a1e09-7376-4439-a5bb-72a26f4865ad for instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 on user Apr 12 11:02:13 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-72f643a9-5589-4663-9fe8-c10d9500ae8b req-9b0cbde5-1751-4609-97bb-b34df6259213 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214373 Apr 12 11:02:13 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 359/1058] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:02:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:02:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.394228 Apr 12 11:02:13 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 348/1059] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 11:02:13 2023] POST /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0/os-volume_attachments => generated 194 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:02:15 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-b9708d16-7cb5-43bd-ab83-66b2acf06550 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:02:15 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-b9708d16-7cb5-43bd-ab83-66b2acf06550 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:02:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b9708d16-7cb5-43bd-ab83-66b2acf06550 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b9708d16-7cb5-43bd-ab83-66b2acf06550 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b9708d16-7cb5-43bd-ab83-66b2acf06550 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b9708d16-7cb5-43bd-ab83-66b2acf06550 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b9708d16-7cb5-43bd-ab83-66b2acf06550 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-b9708d16-7cb5-43bd-ab83-66b2acf06550 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-b9708d16-7cb5-43bd-ab83-66b2acf06550 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048825 Apr 12 11:02:15 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 353/1060] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 11:02:15 2023] GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 11:02:15 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:02:15 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:02:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:15 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:15 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 11:02:15 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644" status: 204 len: 0 microversion: 2.1 time: 0.125304 Apr 12 11:02:15 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 360/1061] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 11:02:15 2023] DELETE /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 11:02:15 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-6ca28020-2b3a-4ce4-88bd-c24a8010a7a1 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:02:15 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-6ca28020-2b3a-4ce4-88bd-c24a8010a7a1 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:02:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6ca28020-2b3a-4ce4-88bd-c24a8010a7a1 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6ca28020-2b3a-4ce4-88bd-c24a8010a7a1 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6ca28020-2b3a-4ce4-88bd-c24a8010a7a1 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6ca28020-2b3a-4ce4-88bd-c24a8010a7a1 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6ca28020-2b3a-4ce4-88bd-c24a8010a7a1 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:15 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-6ca28020-2b3a-4ce4-88bd-c24a8010a7a1 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:15 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-691f7536-be03-42e9-bb4f-2ba9449a7b8c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:02:15 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-691f7536-be03-42e9-bb4f-2ba9449a7b8c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:02:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-691f7536-be03-42e9-bb4f-2ba9449a7b8c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-691f7536-be03-42e9-bb4f-2ba9449a7b8c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-691f7536-be03-42e9-bb4f-2ba9449a7b8c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-691f7536-be03-42e9-bb4f-2ba9449a7b8c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-691f7536-be03-42e9-bb4f-2ba9449a7b8c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-691f7536-be03-42e9-bb4f-2ba9449a7b8c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-691f7536-be03-42e9-bb4f-2ba9449a7b8c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HTTP exception thrown: Instance 948c893b-1292-4b9a-8c77-0e23c94387ae could not be found. Apr 12 11:02:15 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-691f7536-be03-42e9-bb4f-2ba9449a7b8c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Request method failure captured: Apr 12 11:02:15 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/948c893b-1292-4b9a-8c77-0e23c94387ae HTTP/1.1 Apr 12 11:02:15 user devstack@n-api.service[61852]: Accept: application/json Apr 12 11:02:15 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 11:02:15 user devstack@n-api.service[61852]: Connection: close Apr 12 11:02:15 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 11:02:15 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 11:02:15 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 11:02:15 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 11:02:15 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 11:02:15 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNovxs2Yantu_ODChXuBI9nxlNd7q64TcAdmUtsdyhrTlt2TPQv6HrTQUW80fTGqaBlerbQwCAm7dWKzvWOOjt7pPApBNdqpqIJVLzbKcuxIuQw915erA4Eg80ETTsBe76KDhlSBBUJHZF_I_Yg-BxJFHiVfAbJBMyp551Ap5yqYIsVQ Apr 12 11:02:15 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 11:02:15 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 11:02:15 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 11:02:15 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 11:02:15 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 11:02:15 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 11:02:15 user devstack@n-api.service[61852]: X-Project-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 11:02:15 user devstack@n-api.service[61852]: X-Project-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 11:02:15 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 11:02:15 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 11:02:15 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:02:15 user devstack@n-api.service[61852]: X-Tenant: tempest-TestVolumeBootPattern-638607559 Apr 12 11:02:15 user devstack@n-api.service[61852]: X-Tenant-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 11:02:15 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 11:02:15 user devstack@n-api.service[61852]: X-User: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 11:02:15 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 11:02:15 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 11:02:15 user devstack@n-api.service[61852]: X-User-Id: b914d7ca786f455baf120f98816abffd Apr 12 11:02:15 user devstack@n-api.service[61852]: X-User-Name: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 11:02:15 user devstack@n-api.service[61852]: method: > Apr 12 11:02:15 user devstack@n-api.service[61852]: exception: Instance 948c893b-1292-4b9a-8c77-0e23c94387ae could not be found. Apr 12 11:02:15 user devstack@n-api.service[61852]: action_args: {'id': '948c893b-1292-4b9a-8c77-0e23c94387ae'} Apr 12 11:02:15 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 948c893b-1292-4b9a-8c77-0e23c94387ae could not be found. Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 948c893b-1292-4b9a-8c77-0e23c94387ae could not be found. Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 948c893b-1292-4b9a-8c77-0e23c94387ae could not be found. Apr 12 11:02:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:02:15 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-691f7536-be03-42e9-bb4f-2ba9449a7b8c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Returning 404 to user: Instance 948c893b-1292-4b9a-8c77-0e23c94387ae could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:02:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-691f7536-be03-42e9-bb4f-2ba9449a7b8c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/948c893b-1292-4b9a-8c77-0e23c94387ae" status: 404 len: 111 microversion: 2.1 time: 0.178330 Apr 12 11:02:15 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 354/1062] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:02:15 2023] GET /compute/v2.1/servers/948c893b-1292-4b9a-8c77-0e23c94387ae => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 11:02:16 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-3ea41656-9acb-46e4-969d-69d8bcb9fe2e req-b9ff9787-8f97-4c65-a761-36c3035cf6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aef35e7-5daf-4d41-b91b-a7ff4a481644", "name": "network-vif-unplugged", "status": "completed", "tag": "8786a087-f036-403b-9b82-c75fc6dbb110"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:02:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3ea41656-9acb-46e4-969d-69d8bcb9fe2e req-b9ff9787-8f97-4c65-a761-36c3035cf6f3 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3ea41656-9acb-46e4-969d-69d8bcb9fe2e req-b9ff9787-8f97-4c65-a761-36c3035cf6f3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-3ea41656-9acb-46e4-969d-69d8bcb9fe2e req-b9ff9787-8f97-4c65-a761-36c3035cf6f3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-3ea41656-9acb-46e4-969d-69d8bcb9fe2e req-b9ff9787-8f97-4c65-a761-36c3035cf6f3 service nova] Creating event network-vif-unplugged:8786a087-f036-403b-9b82-c75fc6dbb110 for instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 on user Apr 12 11:02:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-3ea41656-9acb-46e4-969d-69d8bcb9fe2e req-b9ff9787-8f97-4c65-a761-36c3035cf6f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110463 Apr 12 11:02:16 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 361/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:02:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:02:16 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-6ca28020-2b3a-4ce4-88bd-c24a8010a7a1 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6576467073e41e9b497097d5a8dfd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9878bfe34ceb4a6695b253ad161c4f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:02:16 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-6ca28020-2b3a-4ce4-88bd-c24a8010a7a1 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644" status: 200 len: 1662 microversion: 2.1 time: 0.765045 Apr 12 11:02:16 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 349/1064] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:02:15 2023] GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644 => generated 1662 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:02:18 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-549cc622-0050-4bb5-a8b5-964b5f0a2211 req-5a5f1110-7c2f-40aa-b32d-1cdb553641fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aef35e7-5daf-4d41-b91b-a7ff4a481644", "name": "network-vif-plugged", "status": "completed", "tag": "8786a087-f036-403b-9b82-c75fc6dbb110"}, {"server_uuid": "2aef35e7-5daf-4d41-b91b-a7ff4a481644", "name": "network-vif-deleted", "tag": "8786a087-f036-403b-9b82-c75fc6dbb110"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:02:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-549cc622-0050-4bb5-a8b5-964b5f0a2211 req-5a5f1110-7c2f-40aa-b32d-1cdb553641fe service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-549cc622-0050-4bb5-a8b5-964b5f0a2211 req-5a5f1110-7c2f-40aa-b32d-1cdb553641fe service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:18 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-549cc622-0050-4bb5-a8b5-964b5f0a2211 req-5a5f1110-7c2f-40aa-b32d-1cdb553641fe service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:18 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-549cc622-0050-4bb5-a8b5-964b5f0a2211 req-5a5f1110-7c2f-40aa-b32d-1cdb553641fe service nova] Creating event network-vif-plugged:8786a087-f036-403b-9b82-c75fc6dbb110 for instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 on user Apr 12 11:02:18 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-549cc622-0050-4bb5-a8b5-964b5f0a2211 req-5a5f1110-7c2f-40aa-b32d-1cdb553641fe service nova] Creating event network-vif-deleted:8786a087-f036-403b-9b82-c75fc6dbb110 for instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 on user Apr 12 11:02:18 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-549cc622-0050-4bb5-a8b5-964b5f0a2211 req-5a5f1110-7c2f-40aa-b32d-1cdb553641fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031644 Apr 12 11:02:18 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 355/1065] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:02:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:02:20 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:02:20 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:02:20 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-373c779f-1f1a-4994-9025-26f55410200b req-3f848090-3959-4de5-870d-f50ce4715dca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280", "tag": "f0316e9d-800d-42f6-9078-eafa6da69f0d"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:02:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-373c779f-1f1a-4994-9025-26f55410200b req-3f848090-3959-4de5-870d-f50ce4715dca service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-373c779f-1f1a-4994-9025-26f55410200b req-3f848090-3959-4de5-870d-f50ce4715dca service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-373c779f-1f1a-4994-9025-26f55410200b req-3f848090-3959-4de5-870d-f50ce4715dca service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:20 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-373c779f-1f1a-4994-9025-26f55410200b req-3f848090-3959-4de5-870d-f50ce4715dca service nova] Creating event network-changed:f0316e9d-800d-42f6-9078-eafa6da69f0d for instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 on user Apr 12 11:02:20 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-373c779f-1f1a-4994-9025-26f55410200b req-3f848090-3959-4de5-870d-f50ce4715dca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031412 Apr 12 11:02:20 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 350/1066] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:02:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:02:20 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 11:02:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" status: 204 len: 0 microversion: 2.1 time: 0.117323 Apr 12 11:02:20 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 362/1067] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 11:02:20 2023] DELETE /compute/v2.1/servers/e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 11:02:20 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-3600fda0-d3e6-4667-ac61-10da26b87ad0 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:02:20 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-3600fda0-d3e6-4667-ac61-10da26b87ad0 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:02:20 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3600fda0-d3e6-4667-ac61-10da26b87ad0 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:20 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3600fda0-d3e6-4667-ac61-10da26b87ad0 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:20 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3600fda0-d3e6-4667-ac61-10da26b87ad0 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:20 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3600fda0-d3e6-4667-ac61-10da26b87ad0 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:20 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3600fda0-d3e6-4667-ac61-10da26b87ad0 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:20 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3600fda0-d3e6-4667-ac61-10da26b87ad0 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:21 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-3600fda0-d3e6-4667-ac61-10da26b87ad0 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:02:21 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-3600fda0-d3e6-4667-ac61-10da26b87ad0 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" status: 200 len: 1565 microversion: 2.1 time: 0.265761 Apr 12 11:02:21 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 356/1068] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:02:20 2023] GET /compute/v2.1/servers/e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 => generated 1565 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:02:21 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-6e4cf014-737e-4e14-a84b-4ca432578e0d req-b9f65b73-9556-494e-9cee-0cb1fa9e5369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280", "name": "network-vif-unplugged", "status": "completed", "tag": "f0316e9d-800d-42f6-9078-eafa6da69f0d"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:02:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6e4cf014-737e-4e14-a84b-4ca432578e0d req-b9f65b73-9556-494e-9cee-0cb1fa9e5369 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6e4cf014-737e-4e14-a84b-4ca432578e0d req-b9f65b73-9556-494e-9cee-0cb1fa9e5369 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:21 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6e4cf014-737e-4e14-a84b-4ca432578e0d req-b9f65b73-9556-494e-9cee-0cb1fa9e5369 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-6e4cf014-737e-4e14-a84b-4ca432578e0d req-b9f65b73-9556-494e-9cee-0cb1fa9e5369 service nova] Creating event network-vif-unplugged:f0316e9d-800d-42f6-9078-eafa6da69f0d for instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 on user Apr 12 11:02:21 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-6e4cf014-737e-4e14-a84b-4ca432578e0d req-b9f65b73-9556-494e-9cee-0cb1fa9e5369 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151720 Apr 12 11:02:21 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 351/1069] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:02:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:02:21 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:02:21 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:02:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:21 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:21 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lazy-loading 'services' on Instance uuid eec82dbf-d946-4aca-9320-8fd0c197e1c0 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 11:02:21 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0/os-volume_attachments/03d8e234-e7b8-4854-8c8c-3f715bbef045" status: 202 len: 0 microversion: 2.1 time: 0.172526 Apr 12 11:02:21 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 363/1070] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 11:02:21 2023] DELETE /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0/os-volume_attachments/03d8e234-e7b8-4854-8c8c-3f715bbef045 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 11:02:21 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-394a1a54-62cf-46cf-821c-719a03e4f4d9 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:02:21 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-394a1a54-62cf-46cf-821c-719a03e4f4d9 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:02:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-394a1a54-62cf-46cf-821c-719a03e4f4d9 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-394a1a54-62cf-46cf-821c-719a03e4f4d9 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-394a1a54-62cf-46cf-821c-719a03e4f4d9 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-394a1a54-62cf-46cf-821c-719a03e4f4d9 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-394a1a54-62cf-46cf-821c-719a03e4f4d9 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:21 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-394a1a54-62cf-46cf-821c-719a03e4f4d9 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:21 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-394a1a54-62cf-46cf-821c-719a03e4f4d9 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074994 Apr 12 11:02:21 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 357/1071] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 11:02:21 2023] GET /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:02:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-1fff48cf-1abb-437f-a509-65fe5f4ef308 req-5fdde0d1-a42e-45db-9268-488e5a9bb947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280", "name": "network-vif-deleted", "tag": "f0316e9d-800d-42f6-9078-eafa6da69f0d"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:02:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1fff48cf-1abb-437f-a509-65fe5f4ef308 req-5fdde0d1-a42e-45db-9268-488e5a9bb947 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1fff48cf-1abb-437f-a509-65fe5f4ef308 req-5fdde0d1-a42e-45db-9268-488e5a9bb947 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-1fff48cf-1abb-437f-a509-65fe5f4ef308 req-5fdde0d1-a42e-45db-9268-488e5a9bb947 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-1fff48cf-1abb-437f-a509-65fe5f4ef308 req-5fdde0d1-a42e-45db-9268-488e5a9bb947 service nova] Creating event network-vif-deleted:f0316e9d-800d-42f6-9078-eafa6da69f0d for instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 on user Apr 12 11:02:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-1fff48cf-1abb-437f-a509-65fe5f4ef308 req-5fdde0d1-a42e-45db-9268-488e5a9bb947 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033007 Apr 12 11:02:22 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 352/1072] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:02:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 11:02:23 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-f83b62c0-c1da-4aa0-9f60-54f0b828ddb8 req-0c5b7be9-cc1d-4bca-b3dc-68ea1392ed7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280", "name": "network-vif-plugged", "status": "completed", "tag": "f0316e9d-800d-42f6-9078-eafa6da69f0d"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:02:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f83b62c0-c1da-4aa0-9f60-54f0b828ddb8 req-0c5b7be9-cc1d-4bca-b3dc-68ea1392ed7a service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f83b62c0-c1da-4aa0-9f60-54f0b828ddb8 req-0c5b7be9-cc1d-4bca-b3dc-68ea1392ed7a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-f83b62c0-c1da-4aa0-9f60-54f0b828ddb8 req-0c5b7be9-cc1d-4bca-b3dc-68ea1392ed7a service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-f83b62c0-c1da-4aa0-9f60-54f0b828ddb8 req-0c5b7be9-cc1d-4bca-b3dc-68ea1392ed7a service nova] Creating event network-vif-plugged:f0316e9d-800d-42f6-9078-eafa6da69f0d for instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 on user Apr 12 11:02:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-f83b62c0-c1da-4aa0-9f60-54f0b828ddb8 req-0c5b7be9-cc1d-4bca-b3dc-68ea1392ed7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032686 Apr 12 11:02:23 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 364/1073] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:02:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:02:25 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-7fdc41e8-fb5a-4452-ae85-9429e72f7922 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:02:25 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-7fdc41e8-fb5a-4452-ae85-9429e72f7922 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:02:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7fdc41e8-fb5a-4452-ae85-9429e72f7922 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7fdc41e8-fb5a-4452-ae85-9429e72f7922 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7fdc41e8-fb5a-4452-ae85-9429e72f7922 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7fdc41e8-fb5a-4452-ae85-9429e72f7922 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7fdc41e8-fb5a-4452-ae85-9429e72f7922 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-7fdc41e8-fb5a-4452-ae85-9429e72f7922 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-7fdc41e8-fb5a-4452-ae85-9429e72f7922 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059675 Apr 12 11:02:25 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 358/1074] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 11:02:25 2023] GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 11:02:28 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740"}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:02:28 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:02:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:28 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:28 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262785 Apr 12 11:02:28 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 353/1075] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 11:02:28 2023] POST /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:02:35 user devstack@n-api.service[61854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 11:02:35 user devstack@n-api.service[61854]: Wed Apr 12 11:02:35 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments/0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 (ip 10.0.0.210) !!! Apr 12 11:02:35 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:02:35 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:02:35 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:02:35 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:02:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:35 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:35 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'services' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 11:02:35 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments/0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740" status: 202 len: 0 microversion: 2.1 time: 0.177422 Apr 12 11:02:35 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 365/1076] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 11:02:35 2023] DELETE /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments/0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 11:02:35 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-abf854d5-2877-42b2-926c-ee2e690f8bca tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:02:35 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-abf854d5-2877-42b2-926c-ee2e690f8bca tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:02:35 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=14 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:02:35 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=34 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:02:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-abf854d5-2877-42b2-926c-ee2e690f8bca tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-abf854d5-2877-42b2-926c-ee2e690f8bca tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-abf854d5-2877-42b2-926c-ee2e690f8bca tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-abf854d5-2877-42b2-926c-ee2e690f8bca tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:02:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-abf854d5-2877-42b2-926c-ee2e690f8bca tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:02:35 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-abf854d5-2877-42b2-926c-ee2e690f8bca tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:02:35 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-abf854d5-2877-42b2-926c-ee2e690f8bca tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052690 Apr 12 11:02:35 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 359/1077] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 11:02:35 2023] GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:03:06 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=12 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:06 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-336f6c2a-7cc1-4928-99cf-551599580847 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:03:06 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-336f6c2a-7cc1-4928-99cf-551599580847 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:03:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-336f6c2a-7cc1-4928-99cf-551599580847 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-336f6c2a-7cc1-4928-99cf-551599580847 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-336f6c2a-7cc1-4928-99cf-551599580847 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-336f6c2a-7cc1-4928-99cf-551599580847 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-336f6c2a-7cc1-4928-99cf-551599580847 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:06 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-336f6c2a-7cc1-4928-99cf-551599580847 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-336f6c2a-7cc1-4928-99cf-551599580847 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] HTTP exception thrown: Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 could not be found. Apr 12 11:03:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-336f6c2a-7cc1-4928-99cf-551599580847 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Request method failure captured: Apr 12 11:03:06 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644 HTTP/1.1 Apr 12 11:03:06 user devstack@n-api.service[61853]: Accept: application/json Apr 12 11:03:06 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 11:03:06 user devstack@n-api.service[61853]: Connection: close Apr 12 11:03:06 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 11:03:06 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 11:03:06 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 11:03:06 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 11:03:06 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 11:03:06 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNo19dItcj2uv6a-AGLGCE-o0Ed4Y6q4btTvpdeiBX0cYjwWCro5TnX1r5gTDzerBUv1mHixLTpPEgMwshuG3-7kJTzxwiwj5d6ZrPYs6Jd-W0IlKnmEOC1yas6y46z-yOKavHnIUSN7LUFJaAxj4gC5DMvrhYC0CUus_q1tB8gbB_UU Apr 12 11:03:06 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 11:03:06 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 11:03:06 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 11:03:06 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 11:03:06 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 11:03:06 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 11:03:06 user devstack@n-api.service[61853]: X-Project-Id: 9878bfe34ceb4a6695b253ad161c4f7b Apr 12 11:03:06 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeTestJSON-1953237893 Apr 12 11:03:06 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 11:03:06 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 11:03:06 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9878bfe34ceb4a6695b253ad161c4f7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9878bfe34ceb4a6695b253ad161c4f7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9878bfe34ceb4a6695b253ad161c4f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:03:06 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeTestJSON-1953237893 Apr 12 11:03:06 user devstack@n-api.service[61853]: X-Tenant-Id: 9878bfe34ceb4a6695b253ad161c4f7b Apr 12 11:03:06 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1953237893 Apr 12 11:03:06 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeTestJSON-1953237893-project-member Apr 12 11:03:06 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 11:03:06 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 11:03:06 user devstack@n-api.service[61853]: X-User-Id: f6576467073e41e9b497097d5a8dfd3d Apr 12 11:03:06 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeTestJSON-1953237893-project-member Apr 12 11:03:06 user devstack@n-api.service[61853]: method: > Apr 12 11:03:06 user devstack@n-api.service[61853]: exception: Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 could not be found. Apr 12 11:03:06 user devstack@n-api.service[61853]: action_args: {'id': '2aef35e7-5daf-4d41-b91b-a7ff4a481644'} Apr 12 11:03:06 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 could not be found. Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 could not be found. Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 could not be found. Apr 12 11:03:06 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:03:06 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-336f6c2a-7cc1-4928-99cf-551599580847 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Returning 404 to user: Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:03:06 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-336f6c2a-7cc1-4928-99cf-551599580847 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644" status: 404 len: 111 microversion: 2.1 time: 0.039749 Apr 12 11:03:06 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 354/1078] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:03:06 2023] GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 11:03:06 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:06 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:06 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-d23b10db-2f3f-4c7b-8df7-e510fbe18ced tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '.version_select at 0x7fabbf8bcca0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:03:06 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-d23b10db-2f3f-4c7b-8df7-e510fbe18ced tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1222347782" status: 202 len: 0 microversion: 2.1 time: 0.028564 Apr 12 11:03:06 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 366/1079] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 11:03:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1222347782 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 11:03:07 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-918f53a4-aa98-4c09-804f-56cb4633702c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Action: 'create', calling method: .version_select at 0x7fabbf6d4550>, body: {"keypair": {"name": "tempest-keypair-1832184664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNumieZsB8oe7GLTZgFC+G6r47EBCDso6tEsNDy7zRRdzpCxU2vuKELKugqdw77z7Fs89HUtjILuEicvB0lsORArcYlMG9UCGVeFqo7InCbLcoNREp0G6jUNvS1QG5UJSw=="}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:03:07 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:07 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:07 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-918f53a4-aa98-4c09-804f-56cb4633702c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Getting quotas for project 9878bfe34ceb4a6695b253ad161c4f7b. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 11:03:07 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-918f53a4-aa98-4c09-804f-56cb4633702c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Getting quotas for user f6576467073e41e9b497097d5a8dfd3d and project 9878bfe34ceb4a6695b253ad161c4f7b. Resources: {'key_pairs'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 11:03:07 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-918f53a4-aa98-4c09-804f-56cb4633702c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057748 Apr 12 11:03:07 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 360/1080] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 11:03:07 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:03:09 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2098924335", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "cd7a59d4-de6d-47fd-acf3-4304f60a460c"}], "security_groups": [{"name": "tempest-securitygroup--1556290164"}], "key_name": "tempest-keypair-1832184664", "user_data": "}} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:03:09 user devstack@n-api.service[61853]: DEBUG nova.network.neutron [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] validate_networks() for [('cd7a59d4-de6d-47fd-acf3-4304f60a460c', None, None, None, None, None)] {{(pid=61853) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 11:03:09 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Flavor limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 11:03:09 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Image limits 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 11:03:09 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Flavor pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 11:03:09 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Image pref 0:0:0 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 11:03:09 user devstack@n-api.service[61853]: DEBUG nova.virt.hardware [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 11:03:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:09 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Getting quotas for project 9878bfe34ceb4a6695b253ad161c4f7b. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 11:03:09 user devstack@n-api.service[61853]: DEBUG nova.quota [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Getting quotas for user f6576467073e41e9b497097d5a8dfd3d and project 9878bfe34ceb4a6695b253ad161c4f7b. Resources: {'cores', 'instances', 'ram'} {{(pid=61853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 11:03:09 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Going to run 1 instances... {{(pid=61853) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 11:03:09 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 11:03:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.619160 Apr 12 11:03:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 355/1081] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 11:03:09 2023] POST /compute/v2.1/servers => generated 400 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 11:03:09 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8ffc6d6a-6a84-41f8-aa82-fbbf568b680e tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:03:09 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-8ffc6d6a-6a84-41f8-aa82-fbbf568b680e tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:03:09 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-8ffc6d6a-6a84-41f8-aa82-fbbf568b680e tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6576467073e41e9b497097d5a8dfd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9878bfe34ceb4a6695b253ad161c4f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:03:09 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8ffc6d6a-6a84-41f8-aa82-fbbf568b680e tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72" status: 200 len: 1232 microversion: 2.1 time: 0.074838 Apr 12 11:03:09 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 367/1082] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:03:09 2023] GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72 => generated 1232 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-3d62f80a-e381-4c8e-bee4-8903c749203a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-3d62f80a-e381-4c8e-bee4-8903c749203a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d62f80a-e381-4c8e-bee4-8903c749203a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d62f80a-e381-4c8e-bee4-8903c749203a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d62f80a-e381-4c8e-bee4-8903c749203a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d62f80a-e381-4c8e-bee4-8903c749203a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d62f80a-e381-4c8e-bee4-8903c749203a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3d62f80a-e381-4c8e-bee4-8903c749203a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:11 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-3d62f80a-e381-4c8e-bee4-8903c749203a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HTTP exception thrown: Instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 could not be found. Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-3d62f80a-e381-4c8e-bee4-8903c749203a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Request method failure captured: Apr 12 11:03:11 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 HTTP/1.1 Apr 12 11:03:11 user devstack@n-api.service[61852]: Accept: application/json Apr 12 11:03:11 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 11:03:11 user devstack@n-api.service[61852]: Connection: close Apr 12 11:03:11 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 11:03:11 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 11:03:11 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 11:03:11 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 11:03:11 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNovxs2Yantu_ODChXuBI9nxlNd7q64TcAdmUtsdyhrTlt2TPQv6HrTQUW80fTGqaBlerbQwCAm7dWKzvWOOjt7pPApBNdqpqIJVLzbKcuxIuQw915erA4Eg80ETTsBe76KDhlSBBUJHZF_I_Yg-BxJFHiVfAbJBMyp551Ap5yqYIsVQ Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Project-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Project-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Tenant: tempest-TestVolumeBootPattern-638607559 Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Tenant-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 11:03:11 user devstack@n-api.service[61852]: X-User: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 11:03:11 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 11:03:11 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 11:03:11 user devstack@n-api.service[61852]: X-User-Id: b914d7ca786f455baf120f98816abffd Apr 12 11:03:11 user devstack@n-api.service[61852]: X-User-Name: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 11:03:11 user devstack@n-api.service[61852]: method: > Apr 12 11:03:11 user devstack@n-api.service[61852]: exception: Instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 could not be found. Apr 12 11:03:11 user devstack@n-api.service[61852]: action_args: {'id': 'e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280'} Apr 12 11:03:11 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 could not be found. Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 could not be found. Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 could not be found. Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-3d62f80a-e381-4c8e-bee4-8903c749203a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Returning 404 to user: Instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:03:11 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-3d62f80a-e381-4c8e-bee4-8903c749203a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" status: 404 len: 111 microversion: 2.1 time: 0.073740 Apr 12 11:03:11 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 361/1083] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:03:11 2023] GET /compute/v2.1/servers/e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 11:03:11 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-377a3254-ff21-4999-8cfb-7d6539038d66 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:03:11 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-377a3254-ff21-4999-8cfb-7d6539038d66 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:03:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-377a3254-ff21-4999-8cfb-7d6539038d66 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-377a3254-ff21-4999-8cfb-7d6539038d66 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-377a3254-ff21-4999-8cfb-7d6539038d66 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-377a3254-ff21-4999-8cfb-7d6539038d66 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-377a3254-ff21-4999-8cfb-7d6539038d66 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:11 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-377a3254-ff21-4999-8cfb-7d6539038d66 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:11 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-377a3254-ff21-4999-8cfb-7d6539038d66 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046905 Apr 12 11:03:11 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 356/1084] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 11:03:11 2023] GET /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 11:03:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ebe9bdbe-9fd4-4100-8d6f-08683caa7ec8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:03:11 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-ebe9bdbe-9fd4-4100-8d6f-08683caa7ec8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:03:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ebe9bdbe-9fd4-4100-8d6f-08683caa7ec8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ebe9bdbe-9fd4-4100-8d6f-08683caa7ec8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ebe9bdbe-9fd4-4100-8d6f-08683caa7ec8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ebe9bdbe-9fd4-4100-8d6f-08683caa7ec8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ebe9bdbe-9fd4-4100-8d6f-08683caa7ec8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:11 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-ebe9bdbe-9fd4-4100-8d6f-08683caa7ec8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-ebe9bdbe-9fd4-4100-8d6f-08683caa7ec8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HTTP exception thrown: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. Apr 12 11:03:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ebe9bdbe-9fd4-4100-8d6f-08683caa7ec8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Request method failure captured: Apr 12 11:03:11 user devstack@n-api.service[61854]: request: DELETE /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de HTTP/1.1 Apr 12 11:03:11 user devstack@n-api.service[61854]: Accept: application/json Apr 12 11:03:11 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 11:03:11 user devstack@n-api.service[61854]: Connection: close Apr 12 11:03:11 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 11:03:11 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 11:03:11 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 11:03:11 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 11:03:11 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 11:03:11 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNovxs2Yantu_ODChXuBI9nxlNd7q64TcAdmUtsdyhrTlt2TPQv6HrTQUW80fTGqaBlerbQwCAm7dWKzvWOOjt7pPApBNdqpqIJVLzbKcuxIuQw915erA4Eg80ETTsBe76KDhlSBBUJHZF_I_Yg-BxJFHiVfAbJBMyp551Ap5yqYIsVQ Apr 12 11:03:11 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 11:03:11 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 11:03:11 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 11:03:11 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 11:03:11 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 11:03:11 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 11:03:11 user devstack@n-api.service[61854]: X-Project-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 11:03:11 user devstack@n-api.service[61854]: X-Project-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 11:03:11 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 11:03:11 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 11:03:11 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:03:11 user devstack@n-api.service[61854]: X-Tenant: tempest-TestVolumeBootPattern-638607559 Apr 12 11:03:11 user devstack@n-api.service[61854]: X-Tenant-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 11:03:11 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 11:03:11 user devstack@n-api.service[61854]: X-User: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 11:03:11 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 11:03:11 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 11:03:11 user devstack@n-api.service[61854]: X-User-Id: b914d7ca786f455baf120f98816abffd Apr 12 11:03:11 user devstack@n-api.service[61854]: X-User-Name: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 11:03:11 user devstack@n-api.service[61854]: method: > Apr 12 11:03:11 user devstack@n-api.service[61854]: exception: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. Apr 12 11:03:11 user devstack@n-api.service[61854]: action_args: {'id': '95469ca9-8f8d-4755-8a00-4e2f5689f3de'} Apr 12 11:03:11 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. Apr 12 11:03:11 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:03:11 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-ebe9bdbe-9fd4-4100-8d6f-08683caa7ec8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Returning 404 to user: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:03:11 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-ebe9bdbe-9fd4-4100-8d6f-08683caa7ec8 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de" status: 404 len: 111 microversion: 2.1 time: 0.035367 Apr 12 11:03:11 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 368/1085] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 11:03:11 2023] DELETE /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-5230ed5c-0b6b-49de-833d-448b94ab5aad tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-5230ed5c-0b6b-49de-833d-448b94ab5aad tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5230ed5c-0b6b-49de-833d-448b94ab5aad tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5230ed5c-0b6b-49de-833d-448b94ab5aad tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5230ed5c-0b6b-49de-833d-448b94ab5aad tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5230ed5c-0b6b-49de-833d-448b94ab5aad tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5230ed5c-0b6b-49de-833d-448b94ab5aad tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5230ed5c-0b6b-49de-833d-448b94ab5aad tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:11 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-5230ed5c-0b6b-49de-833d-448b94ab5aad tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HTTP exception thrown: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-5230ed5c-0b6b-49de-833d-448b94ab5aad tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Request method failure captured: Apr 12 11:03:11 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de HTTP/1.1 Apr 12 11:03:11 user devstack@n-api.service[61852]: Accept: application/json Apr 12 11:03:11 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 11:03:11 user devstack@n-api.service[61852]: Connection: close Apr 12 11:03:11 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 11:03:11 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 11:03:11 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 11:03:11 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 11:03:11 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNovxs2Yantu_ODChXuBI9nxlNd7q64TcAdmUtsdyhrTlt2TPQv6HrTQUW80fTGqaBlerbQwCAm7dWKzvWOOjt7pPApBNdqpqIJVLzbKcuxIuQw915erA4Eg80ETTsBe76KDhlSBBUJHZF_I_Yg-BxJFHiVfAbJBMyp551Ap5yqYIsVQ Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Project-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Project-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a67f3d23b8f74a9496d445c7fc75717e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Tenant: tempest-TestVolumeBootPattern-638607559 Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Tenant-Id: a67f3d23b8f74a9496d445c7fc75717e Apr 12 11:03:11 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-TestVolumeBootPattern-638607559 Apr 12 11:03:11 user devstack@n-api.service[61852]: X-User: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 11:03:11 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 11:03:11 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 11:03:11 user devstack@n-api.service[61852]: X-User-Id: b914d7ca786f455baf120f98816abffd Apr 12 11:03:11 user devstack@n-api.service[61852]: X-User-Name: tempest-TestVolumeBootPattern-638607559-project-member Apr 12 11:03:11 user devstack@n-api.service[61852]: method: > Apr 12 11:03:11 user devstack@n-api.service[61852]: exception: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. Apr 12 11:03:11 user devstack@n-api.service[61852]: action_args: {'id': '95469ca9-8f8d-4755-8a00-4e2f5689f3de'} Apr 12 11:03:11 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. Apr 12 11:03:11 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:03:11 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-5230ed5c-0b6b-49de-833d-448b94ab5aad tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Returning 404 to user: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:03:11 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-5230ed5c-0b6b-49de-833d-448b94ab5aad tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de" status: 404 len: 111 microversion: 2.1 time: 0.029077 Apr 12 11:03:11 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 362/1086] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:03:11 2023] GET /compute/v2.1/servers/95469ca9-8f8d-4755-8a00-4e2f5689f3de => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 11:03:12 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-383f1848-f51e-4247-858b-55037942c49a req-da7448ba-02a9-4e9f-b08f-9d7c78561ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a514b7a-d2a1-40d4-9b25-106a07771d72", "tag": "23d8547c-bdb5-4646-ac12-1dfb693e9491"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:03:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-383f1848-f51e-4247-858b-55037942c49a req-da7448ba-02a9-4e9f-b08f-9d7c78561ef0 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-383f1848-f51e-4247-858b-55037942c49a req-da7448ba-02a9-4e9f-b08f-9d7c78561ef0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-383f1848-f51e-4247-858b-55037942c49a req-da7448ba-02a9-4e9f-b08f-9d7c78561ef0 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:12 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-383f1848-f51e-4247-858b-55037942c49a req-da7448ba-02a9-4e9f-b08f-9d7c78561ef0 service nova] Creating event network-changed:23d8547c-bdb5-4646-ac12-1dfb693e9491 for instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 on user Apr 12 11:03:12 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-383f1848-f51e-4247-858b-55037942c49a req-da7448ba-02a9-4e9f-b08f-9d7c78561ef0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038025 Apr 12 11:03:12 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 357/1087] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:03:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:03:12 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:03:12 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:03:12 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-93ede07d-dc9b-437d-accd-a855e02fe1ff req-ba5f8c50-dde2-41d3-a253-b28fbdb1f1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec82dbf-d946-4aca-9320-8fd0c197e1c0", "tag": "619a1e09-7376-4439-a5bb-72a26f4865ad"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:03:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:12 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:12 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-93ede07d-dc9b-437d-accd-a855e02fe1ff req-ba5f8c50-dde2-41d3-a253-b28fbdb1f1c5 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:12 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-93ede07d-dc9b-437d-accd-a855e02fe1ff req-ba5f8c50-dde2-41d3-a253-b28fbdb1f1c5 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:12 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-93ede07d-dc9b-437d-accd-a855e02fe1ff req-ba5f8c50-dde2-41d3-a253-b28fbdb1f1c5 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:12 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-93ede07d-dc9b-437d-accd-a855e02fe1ff req-ba5f8c50-dde2-41d3-a253-b28fbdb1f1c5 service nova] Creating event network-changed:619a1e09-7376-4439-a5bb-72a26f4865ad for instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 on user Apr 12 11:03:12 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 11:03:12 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-93ede07d-dc9b-437d-accd-a855e02fe1ff req-ba5f8c50-dde2-41d3-a253-b28fbdb1f1c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039654 Apr 12 11:03:12 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 363/1088] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:03:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:03:12 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0" status: 204 len: 0 microversion: 2.1 time: 0.196594 Apr 12 11:03:12 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 369/1089] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 11:03:12 2023] DELETE /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 11:03:12 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-aaaaed2f-3bb6-4ac4-b336-ad46635e716d tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:03:12 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-aaaaed2f-3bb6-4ac4-b336-ad46635e716d tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:03:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-aaaaed2f-3bb6-4ac4-b336-ad46635e716d tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-aaaaed2f-3bb6-4ac4-b336-ad46635e716d tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-aaaaed2f-3bb6-4ac4-b336-ad46635e716d tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-aaaaed2f-3bb6-4ac4-b336-ad46635e716d tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-aaaaed2f-3bb6-4ac4-b336-ad46635e716d tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:12 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-aaaaed2f-3bb6-4ac4-b336-ad46635e716d tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:13 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-aaaaed2f-3bb6-4ac4-b336-ad46635e716d tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed741675f5944f1882c097c411437f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0f2b52a1a04769803c3a44a924ff00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:03:13 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-aaaaed2f-3bb6-4ac4-b336-ad46635e716d tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0" status: 200 len: 1664 microversion: 2.1 time: 0.373378 Apr 12 11:03:13 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 358/1090] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:03:12 2023] GET /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0 => generated 1664 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:03:13 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-41ff70db-d405-45d8-87a1-34a540bec7e0 req-1b0a3850-9a15-46a1-a61c-703672f00538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec82dbf-d946-4aca-9320-8fd0c197e1c0", "name": "network-vif-unplugged", "status": "completed", "tag": "619a1e09-7376-4439-a5bb-72a26f4865ad"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:03:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-41ff70db-d405-45d8-87a1-34a540bec7e0 req-1b0a3850-9a15-46a1-a61c-703672f00538 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-41ff70db-d405-45d8-87a1-34a540bec7e0 req-1b0a3850-9a15-46a1-a61c-703672f00538 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:13 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-41ff70db-d405-45d8-87a1-34a540bec7e0 req-1b0a3850-9a15-46a1-a61c-703672f00538 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:13 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-41ff70db-d405-45d8-87a1-34a540bec7e0 req-1b0a3850-9a15-46a1-a61c-703672f00538 service nova] Creating event network-vif-unplugged:619a1e09-7376-4439-a5bb-72a26f4865ad for instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 on user Apr 12 11:03:13 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-41ff70db-d405-45d8-87a1-34a540bec7e0 req-1b0a3850-9a15-46a1-a61c-703672f00538 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029405 Apr 12 11:03:13 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 364/1091] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:03:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:03:14 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-7961a1e5-513c-40ad-ace7-ac615ebe9ef3 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Calling method '.version_select at 0x7fabbf841630>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:03:14 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-7961a1e5-513c-40ad-ace7-ac615ebe9ef3 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-162796269" status: 202 len: 0 microversion: 2.1 time: 0.036119 Apr 12 11:03:14 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 370/1092] 10.0.0.210 () {62 vars in 1337 bytes} [Wed Apr 12 11:03:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-162796269 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 11:03:14 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-afc81fb1-70af-4983-9e4b-c9b8514e6176 req-8ac25556-9f92-4f6f-a180-0482a4728638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a514b7a-d2a1-40d4-9b25-106a07771d72", "name": "network-vif-plugged", "status": "completed", "tag": "23d8547c-bdb5-4646-ac12-1dfb693e9491"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:03:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-afc81fb1-70af-4983-9e4b-c9b8514e6176 req-8ac25556-9f92-4f6f-a180-0482a4728638 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-afc81fb1-70af-4983-9e4b-c9b8514e6176 req-8ac25556-9f92-4f6f-a180-0482a4728638 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:14 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-afc81fb1-70af-4983-9e4b-c9b8514e6176 req-8ac25556-9f92-4f6f-a180-0482a4728638 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-afc81fb1-70af-4983-9e4b-c9b8514e6176 req-8ac25556-9f92-4f6f-a180-0482a4728638 service nova] Creating event network-vif-plugged:23d8547c-bdb5-4646-ac12-1dfb693e9491 for instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 on user Apr 12 11:03:14 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-afc81fb1-70af-4983-9e4b-c9b8514e6176 req-8ac25556-9f92-4f6f-a180-0482a4728638 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054823 Apr 12 11:03:14 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 359/1093] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:03:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:03:15 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-7ce7540d-2299-4bbc-be90-b76c208c57ac req-73d184f7-b4db-4add-91af-f3a0837f3772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec82dbf-d946-4aca-9320-8fd0c197e1c0", "name": "network-vif-plugged", "status": "completed", "tag": "619a1e09-7376-4439-a5bb-72a26f4865ad"}, {"server_uuid": "eec82dbf-d946-4aca-9320-8fd0c197e1c0", "name": "network-vif-deleted", "tag": "619a1e09-7376-4439-a5bb-72a26f4865ad"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:03:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-7ce7540d-2299-4bbc-be90-b76c208c57ac req-73d184f7-b4db-4add-91af-f3a0837f3772 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-7ce7540d-2299-4bbc-be90-b76c208c57ac req-73d184f7-b4db-4add-91af-f3a0837f3772 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-7ce7540d-2299-4bbc-be90-b76c208c57ac req-73d184f7-b4db-4add-91af-f3a0837f3772 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-7ce7540d-2299-4bbc-be90-b76c208c57ac req-73d184f7-b4db-4add-91af-f3a0837f3772 service nova] Creating event network-vif-plugged:619a1e09-7376-4439-a5bb-72a26f4865ad for instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 on user Apr 12 11:03:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-7ce7540d-2299-4bbc-be90-b76c208c57ac req-73d184f7-b4db-4add-91af-f3a0837f3772 service nova] Creating event network-vif-deleted:619a1e09-7376-4439-a5bb-72a26f4865ad for instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 on user Apr 12 11:03:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-7ce7540d-2299-4bbc-be90-b76c208c57ac req-73d184f7-b4db-4add-91af-f3a0837f3772 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031933 Apr 12 11:03:15 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 365/1094] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:03:15 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:03:16 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-81dca92b-2f99-4aa1-a2e7-7d979a92f334 req-9eb632bb-ed65-4a29-831e-30481dddd82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a514b7a-d2a1-40d4-9b25-106a07771d72", "name": "network-vif-plugged", "status": "completed", "tag": "23d8547c-bdb5-4646-ac12-1dfb693e9491"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:03:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-81dca92b-2f99-4aa1-a2e7-7d979a92f334 req-9eb632bb-ed65-4a29-831e-30481dddd82d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-81dca92b-2f99-4aa1-a2e7-7d979a92f334 req-9eb632bb-ed65-4a29-831e-30481dddd82d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:16 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-81dca92b-2f99-4aa1-a2e7-7d979a92f334 req-9eb632bb-ed65-4a29-831e-30481dddd82d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-81dca92b-2f99-4aa1-a2e7-7d979a92f334 req-9eb632bb-ed65-4a29-831e-30481dddd82d service nova] Creating event network-vif-plugged:23d8547c-bdb5-4646-ac12-1dfb693e9491 for instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 on user Apr 12 11:03:16 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-81dca92b-2f99-4aa1-a2e7-7d979a92f334 req-9eb632bb-ed65-4a29-831e-30481dddd82d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046617 Apr 12 11:03:16 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 371/1095] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:03:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:03:25 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:25 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:25 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:25 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=20 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:26 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-67fa5450-5744-40d2-a252-1692d8b02893 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:03:26 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-67fa5450-5744-40d2-a252-1692d8b02893 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:03:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-67fa5450-5744-40d2-a252-1692d8b02893 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-67fa5450-5744-40d2-a252-1692d8b02893 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-67fa5450-5744-40d2-a252-1692d8b02893 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-67fa5450-5744-40d2-a252-1692d8b02893 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-67fa5450-5744-40d2-a252-1692d8b02893 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:26 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-67fa5450-5744-40d2-a252-1692d8b02893 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:26 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-67fa5450-5744-40d2-a252-1692d8b02893 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.303964 Apr 12 11:03:26 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 360/1096] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 11:03:25 2023] GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments => generated 25 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 11:03:28 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44c78380-6960-40b7-bcdd-3652330d3004"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:03:28 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:03:28 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:28 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:28 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=10 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:28 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:29 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311321 Apr 12 11:03:29 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 366/1097] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 11:03:28 2023] POST /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:03:37 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell0:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:37 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:37 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:37 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:03:37 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:03:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:37 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'services' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 11:03:37 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments/44c78380-6960-40b7-bcdd-3652330d3004" status: 202 len: 0 microversion: 2.1 time: 0.201385 Apr 12 11:03:37 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 372/1098] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 11:03:37 2023] DELETE /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments/44c78380-6960-40b7-bcdd-3652330d3004 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 11:03:37 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-d9c8f3e6-1a2b-421a-bedf-b2b28310f5f8 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:03:37 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-d9c8f3e6-1a2b-421a-bedf-b2b28310f5f8 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:03:37 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:37 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d9c8f3e6-1a2b-421a-bedf-b2b28310f5f8 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d9c8f3e6-1a2b-421a-bedf-b2b28310f5f8 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d9c8f3e6-1a2b-421a-bedf-b2b28310f5f8 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d9c8f3e6-1a2b-421a-bedf-b2b28310f5f8 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:03:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d9c8f3e6-1a2b-421a-bedf-b2b28310f5f8 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:03:37 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-d9c8f3e6-1a2b-421a-bedf-b2b28310f5f8 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:03:37 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-d9c8f3e6-1a2b-421a-bedf-b2b28310f5f8 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051180 Apr 12 11:03:37 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 361/1099] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 11:03:37 2023] GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:03:59 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:03:59 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:04:00 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-3028adcf-cd10-46b1-b61b-75406df4e0af tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:04:00 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-3028adcf-cd10-46b1-b61b-75406df4e0af tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:04:00 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3028adcf-cd10-46b1-b61b-75406df4e0af tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:00 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3028adcf-cd10-46b1-b61b-75406df4e0af tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:00 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3028adcf-cd10-46b1-b61b-75406df4e0af tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:00 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3028adcf-cd10-46b1-b61b-75406df4e0af tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:00 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3028adcf-cd10-46b1-b61b-75406df4e0af tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:00 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3028adcf-cd10-46b1-b61b-75406df4e0af tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:00 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-3028adcf-cd10-46b1-b61b-75406df4e0af tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6576467073e41e9b497097d5a8dfd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9878bfe34ceb4a6695b253ad161c4f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:04:00 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-3028adcf-cd10-46b1-b61b-75406df4e0af tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72" status: 200 len: 1539 microversion: 2.1 time: 0.270997 Apr 12 11:04:00 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 367/1100] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:03:59 2023] GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72 => generated 1539 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:04:03 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:04:03 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:04:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f04cf440-bbc9-4164-bd3b-b078a200b4b1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:04:03 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-f04cf440-bbc9-4164-bd3b-b078a200b4b1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:04:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f04cf440-bbc9-4164-bd3b-b078a200b4b1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f04cf440-bbc9-4164-bd3b-b078a200b4b1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f04cf440-bbc9-4164-bd3b-b078a200b4b1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f04cf440-bbc9-4164-bd3b-b078a200b4b1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f04cf440-bbc9-4164-bd3b-b078a200b4b1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:03 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-f04cf440-bbc9-4164-bd3b-b078a200b4b1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-f04cf440-bbc9-4164-bd3b-b078a200b4b1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] HTTP exception thrown: Instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 could not be found. Apr 12 11:04:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f04cf440-bbc9-4164-bd3b-b078a200b4b1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Request method failure captured: Apr 12 11:04:03 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0 HTTP/1.1 Apr 12 11:04:03 user devstack@n-api.service[61854]: Accept: application/json Apr 12 11:04:03 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 11:04:03 user devstack@n-api.service[61854]: Connection: close Apr 12 11:04:03 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 11:04:03 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 11:04:03 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 11:04:03 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 11:04:03 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 11:04:03 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNo6DdKyfbJOK_tstMD6lRIDDHJ_ohFHr8LQTnMCm_TEvivvWLst-7XGFBvOPFVhFUzSekr6j1Wr1jOif0kEON9sM-gSFit1sIXXX4nqq4lqBh0kUjn1-YEpmFrV_T9KGnBef2Pw7ktOthFdEzcewBOeXOQG0J4MppKDJMxglquBUV40 Apr 12 11:04:03 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 11:04:03 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 11:04:03 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 11:04:03 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 11:04:03 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 11:04:03 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 11:04:03 user devstack@n-api.service[61854]: X-Project-Id: 4a0f2b52a1a04769803c3a44a924ff00 Apr 12 11:04:03 user devstack@n-api.service[61854]: X-Project-Name: tempest-TestStampPattern-1356820597 Apr 12 11:04:03 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 11:04:03 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 11:04:03 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4a0f2b52a1a04769803c3a44a924ff00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a0f2b52a1a04769803c3a44a924ff00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a0f2b52a1a04769803c3a44a924ff00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:04:03 user devstack@n-api.service[61854]: X-Tenant: tempest-TestStampPattern-1356820597 Apr 12 11:04:03 user devstack@n-api.service[61854]: X-Tenant-Id: 4a0f2b52a1a04769803c3a44a924ff00 Apr 12 11:04:03 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-TestStampPattern-1356820597 Apr 12 11:04:03 user devstack@n-api.service[61854]: X-User: tempest-TestStampPattern-1356820597-project-member Apr 12 11:04:03 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 11:04:03 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 11:04:03 user devstack@n-api.service[61854]: X-User-Id: aed741675f5944f1882c097c411437f6 Apr 12 11:04:03 user devstack@n-api.service[61854]: X-User-Name: tempest-TestStampPattern-1356820597-project-member Apr 12 11:04:03 user devstack@n-api.service[61854]: method: > Apr 12 11:04:03 user devstack@n-api.service[61854]: exception: Instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 could not be found. Apr 12 11:04:03 user devstack@n-api.service[61854]: action_args: {'id': 'eec82dbf-d946-4aca-9320-8fd0c197e1c0'} Apr 12 11:04:03 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 could not be found. Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 could not be found. Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 could not be found. Apr 12 11:04:03 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:04:03 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-f04cf440-bbc9-4164-bd3b-b078a200b4b1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Returning 404 to user: Instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:04:03 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-f04cf440-bbc9-4164-bd3b-b078a200b4b1 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0" status: 404 len: 111 microversion: 2.1 time: 0.040838 Apr 12 11:04:03 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 373/1101] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:04:03 2023] GET /compute/v2.1/servers/eec82dbf-d946-4aca-9320-8fd0c197e1c0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 11:04:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-2a536199-4313-428b-9957-c8101dfc8941 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:04:07 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-2a536199-4313-428b-9957-c8101dfc8941 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:04:07 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:04:07 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:04:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2a536199-4313-428b-9957-c8101dfc8941 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2a536199-4313-428b-9957-c8101dfc8941 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2a536199-4313-428b-9957-c8101dfc8941 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2a536199-4313-428b-9957-c8101dfc8941 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2a536199-4313-428b-9957-c8101dfc8941 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:07 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-2a536199-4313-428b-9957-c8101dfc8941 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:07 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-2a536199-4313-428b-9957-c8101dfc8941 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] HTTP exception thrown: Instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 is not attached to volume fc49aa26-cc0b-43ef-98df-a709f5ba48f5 Apr 12 11:04:07 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-2a536199-4313-428b-9957-c8101dfc8941 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Request method failure captured: Apr 12 11:04:07 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6/os-volume_attachments/fc49aa26-cc0b-43ef-98df-a709f5ba48f5 HTTP/1.1 Apr 12 11:04:07 user devstack@n-api.service[61853]: Accept: application/json Apr 12 11:04:07 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 11:04:07 user devstack@n-api.service[61853]: Connection: close Apr 12 11:04:07 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 11:04:07 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 11:04:07 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 11:04:07 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 11:04:07 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 11:04:07 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNo6DdKyfbJOK_tstMD6lRIDDHJ_ohFHr8LQTnMCm_TEvivvWLst-7XGFBvOPFVhFUzSekr6j1Wr1jOif0kEON9sM-gSFit1sIXXX4nqq4lqBh0kUjn1-YEpmFrV_T9KGnBef2Pw7ktOthFdEzcewBOeXOQG0J4MppKDJMxglquBUV40 Apr 12 11:04:07 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 11:04:07 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 11:04:07 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 11:04:07 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 11:04:07 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 11:04:07 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 11:04:07 user devstack@n-api.service[61853]: X-Project-Id: 4a0f2b52a1a04769803c3a44a924ff00 Apr 12 11:04:07 user devstack@n-api.service[61853]: X-Project-Name: tempest-TestStampPattern-1356820597 Apr 12 11:04:07 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 11:04:07 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 11:04:07 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4a0f2b52a1a04769803c3a44a924ff00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a0f2b52a1a04769803c3a44a924ff00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a0f2b52a1a04769803c3a44a924ff00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:04:07 user devstack@n-api.service[61853]: X-Tenant: tempest-TestStampPattern-1356820597 Apr 12 11:04:07 user devstack@n-api.service[61853]: X-Tenant-Id: 4a0f2b52a1a04769803c3a44a924ff00 Apr 12 11:04:07 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TestStampPattern-1356820597 Apr 12 11:04:07 user devstack@n-api.service[61853]: X-User: tempest-TestStampPattern-1356820597-project-member Apr 12 11:04:07 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 11:04:07 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 11:04:07 user devstack@n-api.service[61853]: X-User-Id: aed741675f5944f1882c097c411437f6 Apr 12 11:04:07 user devstack@n-api.service[61853]: X-User-Name: tempest-TestStampPattern-1356820597-project-member Apr 12 11:04:07 user devstack@n-api.service[61853]: method: > Apr 12 11:04:07 user devstack@n-api.service[61853]: exception: Instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 is not attached to volume fc49aa26-cc0b-43ef-98df-a709f5ba48f5 Apr 12 11:04:07 user devstack@n-api.service[61853]: action_args: {'server_id': 'faf5e629-c914-43a1-bd73-ce4adfafe9d6', 'id': 'fc49aa26-cc0b-43ef-98df-a709f5ba48f5'} Apr 12 11:04:07 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fc49aa26-cc0b-43ef-98df-a709f5ba48f5. Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 is not attached to volume fc49aa26-cc0b-43ef-98df-a709f5ba48f5 Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:04:07 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:04:08 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 is not attached to volume fc49aa26-cc0b-43ef-98df-a709f5ba48f5 Apr 12 11:04:08 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:04:08 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-2a536199-4313-428b-9957-c8101dfc8941 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Returning 404 to user: Instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 is not attached to volume fc49aa26-cc0b-43ef-98df-a709f5ba48f5 {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:04:08 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-2a536199-4313-428b-9957-c8101dfc8941 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6/os-volume_attachments/fc49aa26-cc0b-43ef-98df-a709f5ba48f5" status: 404 len: 154 microversion: 2.1 time: 0.137940 Apr 12 11:04:08 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 362/1102] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 11:04:07 2023] DELETE /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6/os-volume_attachments/fc49aa26-cc0b-43ef-98df-a709f5ba48f5 => generated 154 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 11:04:08 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:04:08 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:04:08 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-00c0f9ce-42b1-4deb-8de5-d579716e69ae req-13be1b9f-329f-4794-a0f6-47c37241e6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faf5e629-c914-43a1-bd73-ce4adfafe9d6", "tag": "f43a5f64-a4b2-481b-9785-6a556a795d0a"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:04:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:08 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-00c0f9ce-42b1-4deb-8de5-d579716e69ae req-13be1b9f-329f-4794-a0f6-47c37241e6a4 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-00c0f9ce-42b1-4deb-8de5-d579716e69ae req-13be1b9f-329f-4794-a0f6-47c37241e6a4 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:08 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-00c0f9ce-42b1-4deb-8de5-d579716e69ae req-13be1b9f-329f-4794-a0f6-47c37241e6a4 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-00c0f9ce-42b1-4deb-8de5-d579716e69ae req-13be1b9f-329f-4794-a0f6-47c37241e6a4 service nova] Creating event network-changed:f43a5f64-a4b2-481b-9785-6a556a795d0a for instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 on user Apr 12 11:04:08 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-00c0f9ce-42b1-4deb-8de5-d579716e69ae req-13be1b9f-329f-4794-a0f6-47c37241e6a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030210 Apr 12 11:04:08 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 374/1103] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:04:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:04:08 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 11:04:08 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6" status: 204 len: 0 microversion: 2.1 time: 0.121120 Apr 12 11:04:08 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 368/1104] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 11:04:08 2023] DELETE /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 11:04:08 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-ab8eebe2-0651-4926-9254-478ee828dd06 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:04:08 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-ab8eebe2-0651-4926-9254-478ee828dd06 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:04:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ab8eebe2-0651-4926-9254-478ee828dd06 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ab8eebe2-0651-4926-9254-478ee828dd06 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ab8eebe2-0651-4926-9254-478ee828dd06 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ab8eebe2-0651-4926-9254-478ee828dd06 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ab8eebe2-0651-4926-9254-478ee828dd06 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:08 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-ab8eebe2-0651-4926-9254-478ee828dd06 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:09 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-ab8eebe2-0651-4926-9254-478ee828dd06 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed741675f5944f1882c097c411437f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0f2b52a1a04769803c3a44a924ff00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:04:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-ab8eebe2-0651-4926-9254-478ee828dd06 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6" status: 200 len: 1665 microversion: 2.1 time: 0.307888 Apr 12 11:04:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 363/1105] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:04:08 2023] GET /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6 => generated 1665 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:04:10 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-5b1f81c0-6b03-4ec8-8cb7-28d3b1cda49b req-47f8f276-e6fd-4472-ba75-01c9cca372c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faf5e629-c914-43a1-bd73-ce4adfafe9d6", "name": "network-vif-deleted", "tag": "f43a5f64-a4b2-481b-9785-6a556a795d0a"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:04:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5b1f81c0-6b03-4ec8-8cb7-28d3b1cda49b req-47f8f276-e6fd-4472-ba75-01c9cca372c3 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5b1f81c0-6b03-4ec8-8cb7-28d3b1cda49b req-47f8f276-e6fd-4472-ba75-01c9cca372c3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:10 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-5b1f81c0-6b03-4ec8-8cb7-28d3b1cda49b req-47f8f276-e6fd-4472-ba75-01c9cca372c3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-5b1f81c0-6b03-4ec8-8cb7-28d3b1cda49b req-47f8f276-e6fd-4472-ba75-01c9cca372c3 service nova] Creating event network-vif-deleted:f43a5f64-a4b2-481b-9785-6a556a795d0a for instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 on user Apr 12 11:04:10 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-5b1f81c0-6b03-4ec8-8cb7-28d3b1cda49b req-47f8f276-e6fd-4472-ba75-01c9cca372c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040258 Apr 12 11:04:10 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 375/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:04:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:04:10 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faf5e629-c914-43a1-bd73-ce4adfafe9d6", "name": "network-vif-unplugged", "status": "completed", "tag": "f43a5f64-a4b2-481b-9785-6a556a795d0a"}, {"server_uuid": "faf5e629-c914-43a1-bd73-ce4adfafe9d6", "name": "network-vif-plugged", "status": "completed", "tag": "f43a5f64-a4b2-481b-9785-6a556a795d0a"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:04:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:10 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] Creating event network-vif-unplugged:f43a5f64-a4b2-481b-9785-6a556a795d0a for instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 on user Apr 12 11:04:10 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] Creating event network-vif-plugged:f43a5f64-a4b2-481b-9785-6a556a795d0a for instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 on user Apr 12 11:04:10 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029600 Apr 12 11:04:10 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 369/1107] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:04:10 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:04:27 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-51bcbb7e-dcdd-40ec-8123-6e4fdf4d3a26 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:04:27 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-51bcbb7e-dcdd-40ec-8123-6e4fdf4d3a26 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:04:27 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=4 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:04:27 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=12 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:04:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-51bcbb7e-dcdd-40ec-8123-6e4fdf4d3a26 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-51bcbb7e-dcdd-40ec-8123-6e4fdf4d3a26 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-51bcbb7e-dcdd-40ec-8123-6e4fdf4d3a26 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-51bcbb7e-dcdd-40ec-8123-6e4fdf4d3a26 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-51bcbb7e-dcdd-40ec-8123-6e4fdf4d3a26 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:27 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-51bcbb7e-dcdd-40ec-8123-6e4fdf4d3a26 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:27 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-51bcbb7e-dcdd-40ec-8123-6e4fdf4d3a26 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060055 Apr 12 11:04:27 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 364/1108] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 11:04:27 2023] GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 11:04:41 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:04:41 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:04:41 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-1a91396a-af96-4786-ba36-51dda3d1314f req-a29abe8f-5ea0-4128-836e-8cb6cfde57c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca545a0c-89fd-4a04-9d87-c2698051ca87", "tag": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:04:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-1a91396a-af96-4786-ba36-51dda3d1314f req-a29abe8f-5ea0-4128-836e-8cb6cfde57c3 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-1a91396a-af96-4786-ba36-51dda3d1314f req-a29abe8f-5ea0-4128-836e-8cb6cfde57c3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:41 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-1a91396a-af96-4786-ba36-51dda3d1314f req-a29abe8f-5ea0-4128-836e-8cb6cfde57c3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-1a91396a-af96-4786-ba36-51dda3d1314f req-a29abe8f-5ea0-4128-836e-8cb6cfde57c3 service nova] Creating event network-changed:4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 for instance ca545a0c-89fd-4a04-9d87-c2698051ca87 on user Apr 12 11:04:41 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-1a91396a-af96-4786-ba36-51dda3d1314f req-a29abe8f-5ea0-4128-836e-8cb6cfde57c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036385 Apr 12 11:04:41 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 376/1109] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:04:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:04:43 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:04:43 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:04:43 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:04:43 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:04:43 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:43 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:43 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:43 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:43 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:43 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:43 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 11:04:43 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87" status: 204 len: 0 microversion: 2.1 time: 0.136268 Apr 12 11:04:43 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 370/1110] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 11:04:43 2023] DELETE /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 11:04:43 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-06d7759d-4078-4228-bb50-04bd1100c59d tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:04:43 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-06d7759d-4078-4228-bb50-04bd1100c59d tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:04:43 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:04:43 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:04:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-06d7759d-4078-4228-bb50-04bd1100c59d tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-06d7759d-4078-4228-bb50-04bd1100c59d tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-06d7759d-4078-4228-bb50-04bd1100c59d tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-06d7759d-4078-4228-bb50-04bd1100c59d tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-06d7759d-4078-4228-bb50-04bd1100c59d tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:43 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-06d7759d-4078-4228-bb50-04bd1100c59d tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:44 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-06d7759d-4078-4228-bb50-04bd1100c59d tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325a0abaf7b6485ca97e2d2af2bc9778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7541fb4f462b438dbef4ffe9be4725b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:04:44 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-06d7759d-4078-4228-bb50-04bd1100c59d tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87" status: 200 len: 1574 microversion: 2.1 time: 0.244758 Apr 12 11:04:44 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 365/1111] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:04:43 2023] GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87 => generated 1574 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:04:44 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-cb02ffff-eab1-467d-a209-d733a52796b9 req-ca0580f3-4c94-4046-9602-d6088d7d8053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca545a0c-89fd-4a04-9d87-c2698051ca87", "name": "network-vif-unplugged", "status": "completed", "tag": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:04:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cb02ffff-eab1-467d-a209-d733a52796b9 req-ca0580f3-4c94-4046-9602-d6088d7d8053 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cb02ffff-eab1-467d-a209-d733a52796b9 req-ca0580f3-4c94-4046-9602-d6088d7d8053 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:44 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-cb02ffff-eab1-467d-a209-d733a52796b9 req-ca0580f3-4c94-4046-9602-d6088d7d8053 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-cb02ffff-eab1-467d-a209-d733a52796b9 req-ca0580f3-4c94-4046-9602-d6088d7d8053 service nova] Creating event network-vif-unplugged:4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 for instance ca545a0c-89fd-4a04-9d87-c2698051ca87 on user Apr 12 11:04:44 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-cb02ffff-eab1-467d-a209-d733a52796b9 req-ca0580f3-4c94-4046-9602-d6088d7d8053 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031651 Apr 12 11:04:44 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 377/1112] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:04:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:04:46 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-bcdc03d5-f920-4dc7-99fd-8f958bbf84b2 req-c8d0dc47-b1e9-4347-8150-795e02e401cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca545a0c-89fd-4a04-9d87-c2698051ca87", "name": "network-vif-plugged", "status": "completed", "tag": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74"}, {"server_uuid": "ca545a0c-89fd-4a04-9d87-c2698051ca87", "name": "network-vif-deleted", "tag": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:04:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-bcdc03d5-f920-4dc7-99fd-8f958bbf84b2 req-c8d0dc47-b1e9-4347-8150-795e02e401cc service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-bcdc03d5-f920-4dc7-99fd-8f958bbf84b2 req-c8d0dc47-b1e9-4347-8150-795e02e401cc service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:46 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-bcdc03d5-f920-4dc7-99fd-8f958bbf84b2 req-c8d0dc47-b1e9-4347-8150-795e02e401cc service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-bcdc03d5-f920-4dc7-99fd-8f958bbf84b2 req-c8d0dc47-b1e9-4347-8150-795e02e401cc service nova] Creating event network-vif-plugged:4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 for instance ca545a0c-89fd-4a04-9d87-c2698051ca87 on user Apr 12 11:04:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-bcdc03d5-f920-4dc7-99fd-8f958bbf84b2 req-c8d0dc47-b1e9-4347-8150-795e02e401cc service nova] Creating event network-vif-deleted:4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 for instance ca545a0c-89fd-4a04-9d87-c2698051ca87 on user Apr 12 11:04:46 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-bcdc03d5-f920-4dc7-99fd-8f958bbf84b2 req-c8d0dc47-b1e9-4347-8150-795e02e401cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032043 Apr 12 11:04:46 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 371/1113] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:04:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:04:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7444c618-eb4d-4f3d-addc-e607d352ecc4 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:04:59 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-7444c618-eb4d-4f3d-addc-e607d352ecc4 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:04:59 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:04:59 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:04:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7444c618-eb4d-4f3d-addc-e607d352ecc4 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7444c618-eb4d-4f3d-addc-e607d352ecc4 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7444c618-eb4d-4f3d-addc-e607d352ecc4 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7444c618-eb4d-4f3d-addc-e607d352ecc4 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:04:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7444c618-eb4d-4f3d-addc-e607d352ecc4 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:04:59 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7444c618-eb4d-4f3d-addc-e607d352ecc4 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:04:59 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-7444c618-eb4d-4f3d-addc-e607d352ecc4 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] HTTP exception thrown: Instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 could not be found. Apr 12 11:04:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7444c618-eb4d-4f3d-addc-e607d352ecc4 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Request method failure captured: Apr 12 11:04:59 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6 HTTP/1.1 Apr 12 11:04:59 user devstack@n-api.service[61853]: Accept: application/json Apr 12 11:04:59 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 11:04:59 user devstack@n-api.service[61853]: Connection: close Apr 12 11:04:59 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 11:04:59 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 11:04:59 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 11:04:59 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 11:04:59 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 11:04:59 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNo6DdKyfbJOK_tstMD6lRIDDHJ_ohFHr8LQTnMCm_TEvivvWLst-7XGFBvOPFVhFUzSekr6j1Wr1jOif0kEON9sM-gSFit1sIXXX4nqq4lqBh0kUjn1-YEpmFrV_T9KGnBef2Pw7ktOthFdEzcewBOeXOQG0J4MppKDJMxglquBUV40 Apr 12 11:04:59 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 11:04:59 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 11:04:59 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 11:04:59 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 11:04:59 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 11:04:59 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 11:04:59 user devstack@n-api.service[61853]: X-Project-Id: 4a0f2b52a1a04769803c3a44a924ff00 Apr 12 11:04:59 user devstack@n-api.service[61853]: X-Project-Name: tempest-TestStampPattern-1356820597 Apr 12 11:04:59 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 11:04:59 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 11:04:59 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4a0f2b52a1a04769803c3a44a924ff00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a0f2b52a1a04769803c3a44a924ff00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a0f2b52a1a04769803c3a44a924ff00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:04:59 user devstack@n-api.service[61853]: X-Tenant: tempest-TestStampPattern-1356820597 Apr 12 11:04:59 user devstack@n-api.service[61853]: X-Tenant-Id: 4a0f2b52a1a04769803c3a44a924ff00 Apr 12 11:04:59 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-TestStampPattern-1356820597 Apr 12 11:04:59 user devstack@n-api.service[61853]: X-User: tempest-TestStampPattern-1356820597-project-member Apr 12 11:04:59 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 11:04:59 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 11:04:59 user devstack@n-api.service[61853]: X-User-Id: aed741675f5944f1882c097c411437f6 Apr 12 11:04:59 user devstack@n-api.service[61853]: X-User-Name: tempest-TestStampPattern-1356820597-project-member Apr 12 11:04:59 user devstack@n-api.service[61853]: method: > Apr 12 11:04:59 user devstack@n-api.service[61853]: exception: Instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 could not be found. Apr 12 11:04:59 user devstack@n-api.service[61853]: action_args: {'id': 'faf5e629-c914-43a1-bd73-ce4adfafe9d6'} Apr 12 11:04:59 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 could not be found. Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 could not be found. Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 could not be found. Apr 12 11:04:59 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:04:59 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7444c618-eb4d-4f3d-addc-e607d352ecc4 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Returning 404 to user: Instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:04:59 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-7444c618-eb4d-4f3d-addc-e607d352ecc4 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6" status: 404 len: 111 microversion: 2.1 time: 0.035078 Apr 12 11:04:59 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 366/1114] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:04:59 2023] GET /compute/v2.1/servers/faf5e629-c914-43a1-bd73-ce4adfafe9d6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 11:05:00 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:05:00 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:05:00 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-747c4f77-3035-48a7-bf84-07e1e2293e7f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:05:00 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-747c4f77-3035-48a7-bf84-07e1e2293e7f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:05:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-747c4f77-3035-48a7-bf84-07e1e2293e7f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-747c4f77-3035-48a7-bf84-07e1e2293e7f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-747c4f77-3035-48a7-bf84-07e1e2293e7f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-747c4f77-3035-48a7-bf84-07e1e2293e7f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-747c4f77-3035-48a7-bf84-07e1e2293e7f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:00 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-747c4f77-3035-48a7-bf84-07e1e2293e7f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:00 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-747c4f77-3035-48a7-bf84-07e1e2293e7f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.144243 Apr 12 11:05:00 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 378/1115] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 11:05:00 2023] GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-interface => generated 283 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:05:01 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:05:01 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:05:01 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-15d0d78e-39bd-4303-a879-deb277dbf732 req-07849d74-bc41-490c-82a2-3e4015ca605b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a514b7a-d2a1-40d4-9b25-106a07771d72", "tag": "23d8547c-bdb5-4646-ac12-1dfb693e9491"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:05:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-15d0d78e-39bd-4303-a879-deb277dbf732 req-07849d74-bc41-490c-82a2-3e4015ca605b service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-15d0d78e-39bd-4303-a879-deb277dbf732 req-07849d74-bc41-490c-82a2-3e4015ca605b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:01 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-15d0d78e-39bd-4303-a879-deb277dbf732 req-07849d74-bc41-490c-82a2-3e4015ca605b service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:01 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-15d0d78e-39bd-4303-a879-deb277dbf732 req-07849d74-bc41-490c-82a2-3e4015ca605b service nova] Creating event network-changed:23d8547c-bdb5-4646-ac12-1dfb693e9491 for instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 on user Apr 12 11:05:01 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-15d0d78e-39bd-4303-a879-deb277dbf732 req-07849d74-bc41-490c-82a2-3e4015ca605b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042875 Apr 12 11:05:01 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 372/1116] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:05:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:05:01 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-879df968-06a2-4620-b990-2b2a63531939 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:05:01 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-879df968-06a2-4620-b990-2b2a63531939 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:05:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-879df968-06a2-4620-b990-2b2a63531939 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-879df968-06a2-4620-b990-2b2a63531939 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-879df968-06a2-4620-b990-2b2a63531939 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-879df968-06a2-4620-b990-2b2a63531939 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-879df968-06a2-4620-b990-2b2a63531939 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:01 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-879df968-06a2-4620-b990-2b2a63531939 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:01 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-879df968-06a2-4620-b990-2b2a63531939 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/ips" status: 200 len: 105 microversion: 2.1 time: 0.052424 Apr 12 11:05:01 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 367/1117] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 11:05:01 2023] GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/ips => generated 105 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:05:01 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5b9a666b-5314-496f-99f8-ecd436f72069 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Calling method '.version_select at 0x7fabbf5165f0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:05:01 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5b9a666b-5314-496f-99f8-ecd436f72069 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1731935486" status: 202 len: 0 microversion: 2.1 time: 0.031945 Apr 12 11:05:01 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 379/1118] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 11:05:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1731935486 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 11:05:02 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4269e32-9613-4dbd-be28-6421b7f7ee86"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:05:02 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:05:02 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:02 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:02 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:02 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:02 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:02 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:02 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274920 Apr 12 11:05:02 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 373/1119] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 11:05:02 2023] POST /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:05:09 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-50214e4f-709b-4e3c-a92a-a301eae25227 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:05:09 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-50214e4f-709b-4e3c-a92a-a301eae25227 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:05:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-50214e4f-709b-4e3c-a92a-a301eae25227 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-50214e4f-709b-4e3c-a92a-a301eae25227 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-50214e4f-709b-4e3c-a92a-a301eae25227 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-50214e4f-709b-4e3c-a92a-a301eae25227 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-50214e4f-709b-4e3c-a92a-a301eae25227 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:09 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-50214e4f-709b-4e3c-a92a-a301eae25227 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:09 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-50214e4f-709b-4e3c-a92a-a301eae25227 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042990 Apr 12 11:05:09 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 368/1120] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 11:05:09 2023] GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:05:09 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-8bf34b7a-1ee7-46ef-a21a-53cc6611ece4 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:05:09 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-8bf34b7a-1ee7-46ef-a21a-53cc6611ece4 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:05:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8bf34b7a-1ee7-46ef-a21a-53cc6611ece4 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8bf34b7a-1ee7-46ef-a21a-53cc6611ece4 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8bf34b7a-1ee7-46ef-a21a-53cc6611ece4 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8bf34b7a-1ee7-46ef-a21a-53cc6611ece4 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8bf34b7a-1ee7-46ef-a21a-53cc6611ece4 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:09 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-8bf34b7a-1ee7-46ef-a21a-53cc6611ece4 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:09 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-8bf34b7a-1ee7-46ef-a21a-53cc6611ece4 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments/a4269e32-9613-4dbd-be28-6421b7f7ee86" status: 200 len: 194 microversion: 2.1 time: 0.042134 Apr 12 11:05:09 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 380/1121] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 11:05:09 2023] GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments/a4269e32-9613-4dbd-be28-6421b7f7ee86 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:05:10 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd1c3cf1-d5a9-44a2-813d-6d816218a1be"}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:05:10 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:05:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:10 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:11 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311312 Apr 12 11:05:11 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 374/1122] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 11:05:10 2023] POST /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:05:19 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1d233cc1-64b2-4ce5-bcfc-d2d7ca996dfb tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:05:19 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-1d233cc1-64b2-4ce5-bcfc-d2d7ca996dfb tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:05:19 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:05:19 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=12 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:05:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1d233cc1-64b2-4ce5-bcfc-d2d7ca996dfb tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1d233cc1-64b2-4ce5-bcfc-d2d7ca996dfb tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1d233cc1-64b2-4ce5-bcfc-d2d7ca996dfb tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1d233cc1-64b2-4ce5-bcfc-d2d7ca996dfb tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1d233cc1-64b2-4ce5-bcfc-d2d7ca996dfb tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:19 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1d233cc1-64b2-4ce5-bcfc-d2d7ca996dfb tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:19 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1d233cc1-64b2-4ce5-bcfc-d2d7ca996dfb tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051765 Apr 12 11:05:19 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 369/1123] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 11:05:19 2023] GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:05:19 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-5f022fc5-dfab-4e8d-9b0e-43968d11197c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:05:19 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-5f022fc5-dfab-4e8d-9b0e-43968d11197c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:05:19 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:05:19 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=10 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:05:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5f022fc5-dfab-4e8d-9b0e-43968d11197c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5f022fc5-dfab-4e8d-9b0e-43968d11197c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5f022fc5-dfab-4e8d-9b0e-43968d11197c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5f022fc5-dfab-4e8d-9b0e-43968d11197c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5f022fc5-dfab-4e8d-9b0e-43968d11197c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:19 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-5f022fc5-dfab-4e8d-9b0e-43968d11197c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:19 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-5f022fc5-dfab-4e8d-9b0e-43968d11197c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments/a4269e32-9613-4dbd-be28-6421b7f7ee86" status: 200 len: 194 microversion: 2.1 time: 0.047534 Apr 12 11:05:19 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 381/1124] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 11:05:19 2023] GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments/a4269e32-9613-4dbd-be28-6421b7f7ee86 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:05:19 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:05:19 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:05:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:19 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:20 user devstack@n-api.service[61852]: DEBUG nova.objects.instance [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'services' on Instance uuid 8a514b7a-d2a1-40d4-9b25-106a07771d72 {{(pid=61852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 11:05:20 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments/a4269e32-9613-4dbd-be28-6421b7f7ee86" status: 202 len: 0 microversion: 2.1 time: 0.191255 Apr 12 11:05:20 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 375/1125] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 11:05:19 2023] DELETE /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments/a4269e32-9613-4dbd-be28-6421b7f7ee86 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 11:05:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-4d9b6639-da6c-45a9-b3a7-d77b08011c75 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:05:22 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-4d9b6639-da6c-45a9-b3a7-d77b08011c75 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:05:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4d9b6639-da6c-45a9-b3a7-d77b08011c75 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4d9b6639-da6c-45a9-b3a7-d77b08011c75 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4d9b6639-da6c-45a9-b3a7-d77b08011c75 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4d9b6639-da6c-45a9-b3a7-d77b08011c75 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4d9b6639-da6c-45a9-b3a7-d77b08011c75 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-4d9b6639-da6c-45a9-b3a7-d77b08011c75 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:22 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-4d9b6639-da6c-45a9-b3a7-d77b08011c75 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments/fd1c3cf1-d5a9-44a2-813d-6d816218a1be" status: 200 len: 194 microversion: 2.1 time: 0.044119 Apr 12 11:05:22 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 370/1126] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 11:05:22 2023] GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments/fd1c3cf1-d5a9-44a2-813d-6d816218a1be => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:05:22 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:05:22 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:05:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:22 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:22 user devstack@n-api.service[61854]: DEBUG nova.objects.instance [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'services' on Instance uuid 8a514b7a-d2a1-40d4-9b25-106a07771d72 {{(pid=61854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 11:05:22 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments/fd1c3cf1-d5a9-44a2-813d-6d816218a1be" status: 202 len: 0 microversion: 2.1 time: 0.174341 Apr 12 11:05:22 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 382/1127] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 11:05:22 2023] DELETE /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments/fd1c3cf1-d5a9-44a2-813d-6d816218a1be => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 11:05:24 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-50fd343e-c444-4e32-a487-cfb3e0b7262d tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:05:24 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-50fd343e-c444-4e32-a487-cfb3e0b7262d tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:05:24 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-50fd343e-c444-4e32-a487-cfb3e0b7262d tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:24 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-50fd343e-c444-4e32-a487-cfb3e0b7262d tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:24 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-50fd343e-c444-4e32-a487-cfb3e0b7262d tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:24 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-50fd343e-c444-4e32-a487-cfb3e0b7262d tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:24 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-50fd343e-c444-4e32-a487-cfb3e0b7262d tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:24 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-50fd343e-c444-4e32-a487-cfb3e0b7262d tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:24 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-50fd343e-c444-4e32-a487-cfb3e0b7262d tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048447 Apr 12 11:05:24 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 376/1128] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 11:05:24 2023] GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 11:05:24 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-bce1f054-6caf-4c43-be3f-f0fdf161bae2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:05:24 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-bce1f054-6caf-4c43-be3f-f0fdf161bae2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:05:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bce1f054-6caf-4c43-be3f-f0fdf161bae2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bce1f054-6caf-4c43-be3f-f0fdf161bae2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bce1f054-6caf-4c43-be3f-f0fdf161bae2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bce1f054-6caf-4c43-be3f-f0fdf161bae2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bce1f054-6caf-4c43-be3f-f0fdf161bae2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:24 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-bce1f054-6caf-4c43-be3f-f0fdf161bae2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:24 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-bce1f054-6caf-4c43-be3f-f0fdf161bae2 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044359 Apr 12 11:05:24 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 371/1129] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 11:05:24 2023] GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 11:05:25 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:05:25 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:05:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:25 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:25 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Going to try to terminate instance {{(pid=61854) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 11:05:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72" status: 204 len: 0 microversion: 2.1 time: 0.141072 Apr 12 11:05:25 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 383/1130] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 11:05:25 2023] DELETE /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 11:05:25 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-c38bbd78-877f-4226-8a98-a62599c71eba tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:05:25 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-c38bbd78-877f-4226-8a98-a62599c71eba tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:05:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c38bbd78-877f-4226-8a98-a62599c71eba tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c38bbd78-877f-4226-8a98-a62599c71eba tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c38bbd78-877f-4226-8a98-a62599c71eba tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c38bbd78-877f-4226-8a98-a62599c71eba tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c38bbd78-877f-4226-8a98-a62599c71eba tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:25 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-c38bbd78-877f-4226-8a98-a62599c71eba tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:25 user devstack@n-api.service[61852]: DEBUG nova.policy [None req-c38bbd78-877f-4226-8a98-a62599c71eba tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6576467073e41e9b497097d5a8dfd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9878bfe34ceb4a6695b253ad161c4f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61852) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:05:25 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-c38bbd78-877f-4226-8a98-a62599c71eba tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72" status: 200 len: 1664 microversion: 2.1 time: 0.340472 Apr 12 11:05:25 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 377/1131] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:05:25 2023] GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72 => generated 1664 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:05:25 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-6714c904-c35a-4702-8820-6e169a6b128e req-7fbb7a83-acaa-4045-8306-f4650a154d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a514b7a-d2a1-40d4-9b25-106a07771d72", "name": "network-vif-unplugged", "status": "completed", "tag": "23d8547c-bdb5-4646-ac12-1dfb693e9491"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:05:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6714c904-c35a-4702-8820-6e169a6b128e req-7fbb7a83-acaa-4045-8306-f4650a154d46 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6714c904-c35a-4702-8820-6e169a6b128e req-7fbb7a83-acaa-4045-8306-f4650a154d46 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:25 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-6714c904-c35a-4702-8820-6e169a6b128e req-7fbb7a83-acaa-4045-8306-f4650a154d46 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:25 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-6714c904-c35a-4702-8820-6e169a6b128e req-7fbb7a83-acaa-4045-8306-f4650a154d46 service nova] Creating event network-vif-unplugged:23d8547c-bdb5-4646-ac12-1dfb693e9491 for instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 on user Apr 12 11:05:25 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-6714c904-c35a-4702-8820-6e169a6b128e req-7fbb7a83-acaa-4045-8306-f4650a154d46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065922 Apr 12 11:05:25 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 372/1132] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:05:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:05:27 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-7c19e0f0-bf45-417f-b7a7-2d4f4c46d4c2 req-aeb4bea7-d8d1-4e89-b39d-0a008089ee18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a514b7a-d2a1-40d4-9b25-106a07771d72", "name": "network-vif-deleted", "tag": "23d8547c-bdb5-4646-ac12-1dfb693e9491"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:05:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7c19e0f0-bf45-417f-b7a7-2d4f4c46d4c2 req-aeb4bea7-d8d1-4e89-b39d-0a008089ee18 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7c19e0f0-bf45-417f-b7a7-2d4f4c46d4c2 req-aeb4bea7-d8d1-4e89-b39d-0a008089ee18 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:27 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-7c19e0f0-bf45-417f-b7a7-2d4f4c46d4c2 req-aeb4bea7-d8d1-4e89-b39d-0a008089ee18 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:27 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-7c19e0f0-bf45-417f-b7a7-2d4f4c46d4c2 req-aeb4bea7-d8d1-4e89-b39d-0a008089ee18 service nova] Creating event network-vif-deleted:23d8547c-bdb5-4646-ac12-1dfb693e9491 for instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 on user Apr 12 11:05:27 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-7c19e0f0-bf45-417f-b7a7-2d4f4c46d4c2 req-aeb4bea7-d8d1-4e89-b39d-0a008089ee18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030963 Apr 12 11:05:27 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 384/1133] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:05:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:05:27 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-0ebd9251-ff93-4190-89a6-b10ef916af88 req-793e5e99-1c6b-484f-90bc-c89f0372a30e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a514b7a-d2a1-40d4-9b25-106a07771d72", "name": "network-vif-plugged", "status": "completed", "tag": "23d8547c-bdb5-4646-ac12-1dfb693e9491"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:05:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-0ebd9251-ff93-4190-89a6-b10ef916af88 req-793e5e99-1c6b-484f-90bc-c89f0372a30e service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-0ebd9251-ff93-4190-89a6-b10ef916af88 req-793e5e99-1c6b-484f-90bc-c89f0372a30e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:27 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-0ebd9251-ff93-4190-89a6-b10ef916af88 req-793e5e99-1c6b-484f-90bc-c89f0372a30e service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:27 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-0ebd9251-ff93-4190-89a6-b10ef916af88 req-793e5e99-1c6b-484f-90bc-c89f0372a30e service nova] Creating event network-vif-plugged:23d8547c-bdb5-4646-ac12-1dfb693e9491 for instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 on user Apr 12 11:05:27 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-0ebd9251-ff93-4190-89a6-b10ef916af88 req-793e5e99-1c6b-484f-90bc-c89f0372a30e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044299 Apr 12 11:05:27 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 378/1134] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:05:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:05:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7abbe3ae-b75b-4542-8f59-204bee6d7637 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:05:34 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-7abbe3ae-b75b-4542-8f59-204bee6d7637 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:05:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7abbe3ae-b75b-4542-8f59-204bee6d7637 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7abbe3ae-b75b-4542-8f59-204bee6d7637 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7abbe3ae-b75b-4542-8f59-204bee6d7637 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7abbe3ae-b75b-4542-8f59-204bee6d7637 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:05:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7abbe3ae-b75b-4542-8f59-204bee6d7637 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:05:34 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-7abbe3ae-b75b-4542-8f59-204bee6d7637 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:05:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-7abbe3ae-b75b-4542-8f59-204bee6d7637 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] HTTP exception thrown: Instance ca545a0c-89fd-4a04-9d87-c2698051ca87 could not be found. Apr 12 11:05:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7abbe3ae-b75b-4542-8f59-204bee6d7637 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Request method failure captured: Apr 12 11:05:34 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87 HTTP/1.1 Apr 12 11:05:34 user devstack@n-api.service[61853]: Accept: application/json Apr 12 11:05:34 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 11:05:34 user devstack@n-api.service[61853]: Connection: close Apr 12 11:05:34 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 11:05:34 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 11:05:34 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 11:05:34 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 11:05:34 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 11:05:34 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNo7FUOP8KNZgvPmJ11vonJjA_vtkZxn8TzfzE6Sw8NCH121HVbyjRk0eTyTSLTBVwhRRPzw_fTaXRvosSoTS8EiFylOBxRURNkvjjWUbhSt8PTWFuGIUuZk6zP9UwO_12we35HgzW7HCSD-4zKOkd00dy1ah1soKeYTbSeINAvZK3qM Apr 12 11:05:34 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 11:05:34 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 11:05:34 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 11:05:34 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 11:05:34 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 11:05:34 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 11:05:34 user devstack@n-api.service[61853]: X-Project-Id: 7541fb4f462b438dbef4ffe9be4725b5 Apr 12 11:05:34 user devstack@n-api.service[61853]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1196660338 Apr 12 11:05:34 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 11:05:34 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 11:05:34 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7541fb4f462b438dbef4ffe9be4725b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7541fb4f462b438dbef4ffe9be4725b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7541fb4f462b438dbef4ffe9be4725b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:05:34 user devstack@n-api.service[61853]: X-Tenant: tempest-SnapshotDataIntegrityTests-1196660338 Apr 12 11:05:34 user devstack@n-api.service[61853]: X-Tenant-Id: 7541fb4f462b438dbef4ffe9be4725b5 Apr 12 11:05:34 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1196660338 Apr 12 11:05:34 user devstack@n-api.service[61853]: X-User: tempest-SnapshotDataIntegrityTests-1196660338-project-member Apr 12 11:05:34 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 11:05:34 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 11:05:34 user devstack@n-api.service[61853]: X-User-Id: 325a0abaf7b6485ca97e2d2af2bc9778 Apr 12 11:05:34 user devstack@n-api.service[61853]: X-User-Name: tempest-SnapshotDataIntegrityTests-1196660338-project-member Apr 12 11:05:34 user devstack@n-api.service[61853]: method: > Apr 12 11:05:34 user devstack@n-api.service[61853]: exception: Instance ca545a0c-89fd-4a04-9d87-c2698051ca87 could not be found. Apr 12 11:05:34 user devstack@n-api.service[61853]: action_args: {'id': 'ca545a0c-89fd-4a04-9d87-c2698051ca87'} Apr 12 11:05:34 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca545a0c-89fd-4a04-9d87-c2698051ca87 could not be found. Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca545a0c-89fd-4a04-9d87-c2698051ca87 could not be found. Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca545a0c-89fd-4a04-9d87-c2698051ca87 could not be found. Apr 12 11:05:34 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:05:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-7abbe3ae-b75b-4542-8f59-204bee6d7637 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Returning 404 to user: Instance ca545a0c-89fd-4a04-9d87-c2698051ca87 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:05:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-7abbe3ae-b75b-4542-8f59-204bee6d7637 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87" status: 404 len: 111 microversion: 2.1 time: 0.030652 Apr 12 11:05:34 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 373/1135] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:05:34 2023] GET /compute/v2.1/servers/ca545a0c-89fd-4a04-9d87-c2698051ca87 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 11:05:34 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-1a0720ab-22ba-46b3-a628-2f8d5645cbc5 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Calling method '.version_select at 0x7fabbf5160e0>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:05:34 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-1a0720ab-22ba-46b3-a628-2f8d5645cbc5 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1583885298" status: 202 len: 0 microversion: 2.1 time: 0.025182 Apr 12 11:05:34 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 385/1136] 10.0.0.210 () {62 vars in 1355 bytes} [Wed Apr 12 11:05:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1583885298 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 11:06:15 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=14 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:06:15 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:06:15 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-0c5e2314-8b46-46b4-a4cf-cefd1f72124b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:06:15 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-0c5e2314-8b46-46b4-a4cf-cefd1f72124b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:06:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0c5e2314-8b46-46b4-a4cf-cefd1f72124b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:06:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0c5e2314-8b46-46b4-a4cf-cefd1f72124b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:06:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0c5e2314-8b46-46b4-a4cf-cefd1f72124b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:06:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0c5e2314-8b46-46b4-a4cf-cefd1f72124b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:06:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0c5e2314-8b46-46b4-a4cf-cefd1f72124b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:06:15 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-0c5e2314-8b46-46b4-a4cf-cefd1f72124b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:06:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-0c5e2314-8b46-46b4-a4cf-cefd1f72124b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] HTTP exception thrown: Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 could not be found. Apr 12 11:06:15 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-0c5e2314-8b46-46b4-a4cf-cefd1f72124b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Request method failure captured: Apr 12 11:06:15 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72 HTTP/1.1 Apr 12 11:06:15 user devstack@n-api.service[61852]: Accept: application/json Apr 12 11:06:15 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 11:06:15 user devstack@n-api.service[61852]: Connection: close Apr 12 11:06:15 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 11:06:15 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 11:06:15 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 11:06:15 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 11:06:15 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 11:06:15 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNo19dItcj2uv6a-AGLGCE-o0Ed4Y6q4btTvpdeiBX0cYjwWCro5TnX1r5gTDzerBUv1mHixLTpPEgMwshuG3-7kJTzxwiwj5d6ZrPYs6Jd-W0IlKnmEOC1yas6y46z-yOKavHnIUSN7LUFJaAxj4gC5DMvrhYC0CUus_q1tB8gbB_UU Apr 12 11:06:15 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 11:06:15 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 11:06:15 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 11:06:15 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 11:06:15 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 11:06:15 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 11:06:15 user devstack@n-api.service[61852]: X-Project-Id: 9878bfe34ceb4a6695b253ad161c4f7b Apr 12 11:06:15 user devstack@n-api.service[61852]: X-Project-Name: tempest-AttachVolumeTestJSON-1953237893 Apr 12 11:06:15 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 11:06:15 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 11:06:15 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9878bfe34ceb4a6695b253ad161c4f7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9878bfe34ceb4a6695b253ad161c4f7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9878bfe34ceb4a6695b253ad161c4f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:06:15 user devstack@n-api.service[61852]: X-Tenant: tempest-AttachVolumeTestJSON-1953237893 Apr 12 11:06:15 user devstack@n-api.service[61852]: X-Tenant-Id: 9878bfe34ceb4a6695b253ad161c4f7b Apr 12 11:06:15 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1953237893 Apr 12 11:06:15 user devstack@n-api.service[61852]: X-User: tempest-AttachVolumeTestJSON-1953237893-project-member Apr 12 11:06:15 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 11:06:15 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 11:06:15 user devstack@n-api.service[61852]: X-User-Id: f6576467073e41e9b497097d5a8dfd3d Apr 12 11:06:15 user devstack@n-api.service[61852]: X-User-Name: tempest-AttachVolumeTestJSON-1953237893-project-member Apr 12 11:06:15 user devstack@n-api.service[61852]: method: > Apr 12 11:06:15 user devstack@n-api.service[61852]: exception: Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 could not be found. Apr 12 11:06:15 user devstack@n-api.service[61852]: action_args: {'id': '8a514b7a-d2a1-40d4-9b25-106a07771d72'} Apr 12 11:06:15 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 could not be found. Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 could not be found. Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 could not be found. Apr 12 11:06:15 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:06:15 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-0c5e2314-8b46-46b4-a4cf-cefd1f72124b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Returning 404 to user: Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:06:15 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-0c5e2314-8b46-46b4-a4cf-cefd1f72124b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72" status: 404 len: 111 microversion: 2.1 time: 0.039657 Apr 12 11:06:15 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 379/1137] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:06:15 2023] GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 11:06:15 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8729e83e-a2a3-4f8a-b8f8-d3e969925695 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '.version_select at 0x7fabbf52ae60>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:06:15 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=10 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:06:15 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=22 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:06:15 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8729e83e-a2a3-4f8a-b8f8-d3e969925695 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832184664" status: 202 len: 0 microversion: 2.1 time: 0.028443 Apr 12 11:06:15 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 374/1138] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 11:06:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832184664 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 11:06:20 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:06:20 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:06:20 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-af76b7d6-97f6-4192-88be-4559d87b29da tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:06:20 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-af76b7d6-97f6-4192-88be-4559d87b29da tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:06:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-af76b7d6-97f6-4192-88be-4559d87b29da tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:06:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-af76b7d6-97f6-4192-88be-4559d87b29da tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:06:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-af76b7d6-97f6-4192-88be-4559d87b29da tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:06:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-af76b7d6-97f6-4192-88be-4559d87b29da tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:06:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-af76b7d6-97f6-4192-88be-4559d87b29da tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:06:20 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-af76b7d6-97f6-4192-88be-4559d87b29da tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:06:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-af76b7d6-97f6-4192-88be-4559d87b29da tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] HTTP exception thrown: Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 could not be found. Apr 12 11:06:20 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-af76b7d6-97f6-4192-88be-4559d87b29da tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Request method failure captured: Apr 12 11:06:20 user devstack@n-api.service[61854]: request: DELETE /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72 HTTP/1.1 Apr 12 11:06:20 user devstack@n-api.service[61854]: Accept: application/json Apr 12 11:06:20 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 11:06:20 user devstack@n-api.service[61854]: Connection: close Apr 12 11:06:20 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 11:06:20 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 11:06:20 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 11:06:20 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 11:06:20 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 11:06:20 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNo19dItcj2uv6a-AGLGCE-o0Ed4Y6q4btTvpdeiBX0cYjwWCro5TnX1r5gTDzerBUv1mHixLTpPEgMwshuG3-7kJTzxwiwj5d6ZrPYs6Jd-W0IlKnmEOC1yas6y46z-yOKavHnIUSN7LUFJaAxj4gC5DMvrhYC0CUus_q1tB8gbB_UU Apr 12 11:06:20 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 11:06:20 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 11:06:20 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 11:06:20 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 11:06:20 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 11:06:20 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 11:06:20 user devstack@n-api.service[61854]: X-Project-Id: 9878bfe34ceb4a6695b253ad161c4f7b Apr 12 11:06:20 user devstack@n-api.service[61854]: X-Project-Name: tempest-AttachVolumeTestJSON-1953237893 Apr 12 11:06:20 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 11:06:20 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 11:06:20 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9878bfe34ceb4a6695b253ad161c4f7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9878bfe34ceb4a6695b253ad161c4f7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9878bfe34ceb4a6695b253ad161c4f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:06:20 user devstack@n-api.service[61854]: X-Tenant: tempest-AttachVolumeTestJSON-1953237893 Apr 12 11:06:20 user devstack@n-api.service[61854]: X-Tenant-Id: 9878bfe34ceb4a6695b253ad161c4f7b Apr 12 11:06:20 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1953237893 Apr 12 11:06:20 user devstack@n-api.service[61854]: X-User: tempest-AttachVolumeTestJSON-1953237893-project-member Apr 12 11:06:20 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 11:06:20 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 11:06:20 user devstack@n-api.service[61854]: X-User-Id: f6576467073e41e9b497097d5a8dfd3d Apr 12 11:06:20 user devstack@n-api.service[61854]: X-User-Name: tempest-AttachVolumeTestJSON-1953237893-project-member Apr 12 11:06:20 user devstack@n-api.service[61854]: method: > Apr 12 11:06:20 user devstack@n-api.service[61854]: exception: Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 could not be found. Apr 12 11:06:20 user devstack@n-api.service[61854]: action_args: {'id': '8a514b7a-d2a1-40d4-9b25-106a07771d72'} Apr 12 11:06:20 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 could not be found. Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 could not be found. Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 could not be found. Apr 12 11:06:20 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:06:20 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-af76b7d6-97f6-4192-88be-4559d87b29da tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Returning 404 to user: Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:06:20 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-af76b7d6-97f6-4192-88be-4559d87b29da tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72" status: 404 len: 111 microversion: 2.1 time: 0.038345 Apr 12 11:06:20 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 386/1139] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 11:06:20 2023] DELETE /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 11:06:20 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-930893d3-b72a-4b78-ae35-5c57f568ab83 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:06:20 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-930893d3-b72a-4b78-ae35-5c57f568ab83 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:06:20 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-930893d3-b72a-4b78-ae35-5c57f568ab83 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:06:20 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-930893d3-b72a-4b78-ae35-5c57f568ab83 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:06:20 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-930893d3-b72a-4b78-ae35-5c57f568ab83 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:06:20 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-930893d3-b72a-4b78-ae35-5c57f568ab83 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:06:20 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-930893d3-b72a-4b78-ae35-5c57f568ab83 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:06:20 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-930893d3-b72a-4b78-ae35-5c57f568ab83 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:06:20 user devstack@n-api.service[61852]: INFO nova.api.openstack.wsgi [None req-930893d3-b72a-4b78-ae35-5c57f568ab83 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] HTTP exception thrown: Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 could not be found. Apr 12 11:06:20 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-930893d3-b72a-4b78-ae35-5c57f568ab83 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Request method failure captured: Apr 12 11:06:20 user devstack@n-api.service[61852]: request: GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72 HTTP/1.1 Apr 12 11:06:20 user devstack@n-api.service[61852]: Accept: application/json Apr 12 11:06:20 user devstack@n-api.service[61852]: Accept-Encoding: identity Apr 12 11:06:20 user devstack@n-api.service[61852]: Connection: close Apr 12 11:06:20 user devstack@n-api.service[61852]: Content-Length: 0 Apr 12 11:06:20 user devstack@n-api.service[61852]: Content-Type: application/json Apr 12 11:06:20 user devstack@n-api.service[61852]: Host: 10.0.0.210 Apr 12 11:06:20 user devstack@n-api.service[61852]: Openstack-System-Scope: None Apr 12 11:06:20 user devstack@n-api.service[61852]: User-Agent: python-urllib3/1.26.15 Apr 12 11:06:20 user devstack@n-api.service[61852]: X-Auth-Token: gAAAAABkNo19dItcj2uv6a-AGLGCE-o0Ed4Y6q4btTvpdeiBX0cYjwWCro5TnX1r5gTDzerBUv1mHixLTpPEgMwshuG3-7kJTzxwiwj5d6ZrPYs6Jd-W0IlKnmEOC1yas6y46z-yOKavHnIUSN7LUFJaAxj4gC5DMvrhYC0CUus_q1tB8gbB_UU Apr 12 11:06:20 user devstack@n-api.service[61852]: X-Domain-Id: None Apr 12 11:06:20 user devstack@n-api.service[61852]: X-Domain-Name: None Apr 12 11:06:20 user devstack@n-api.service[61852]: X-Identity-Status: Confirmed Apr 12 11:06:20 user devstack@n-api.service[61852]: X-Is-Admin-Project: True Apr 12 11:06:20 user devstack@n-api.service[61852]: X-Project-Domain-Id: default Apr 12 11:06:20 user devstack@n-api.service[61852]: X-Project-Domain-Name: Default Apr 12 11:06:20 user devstack@n-api.service[61852]: X-Project-Id: 9878bfe34ceb4a6695b253ad161c4f7b Apr 12 11:06:20 user devstack@n-api.service[61852]: X-Project-Name: tempest-AttachVolumeTestJSON-1953237893 Apr 12 11:06:20 user devstack@n-api.service[61852]: X-Role: member,reader Apr 12 11:06:20 user devstack@n-api.service[61852]: X-Roles: member,reader Apr 12 11:06:20 user devstack@n-api.service[61852]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9878bfe34ceb4a6695b253ad161c4f7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9878bfe34ceb4a6695b253ad161c4f7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9878bfe34ceb4a6695b253ad161c4f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:06:20 user devstack@n-api.service[61852]: X-Tenant: tempest-AttachVolumeTestJSON-1953237893 Apr 12 11:06:20 user devstack@n-api.service[61852]: X-Tenant-Id: 9878bfe34ceb4a6695b253ad161c4f7b Apr 12 11:06:20 user devstack@n-api.service[61852]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1953237893 Apr 12 11:06:20 user devstack@n-api.service[61852]: X-User: tempest-AttachVolumeTestJSON-1953237893-project-member Apr 12 11:06:20 user devstack@n-api.service[61852]: X-User-Domain-Id: default Apr 12 11:06:20 user devstack@n-api.service[61852]: X-User-Domain-Name: Default Apr 12 11:06:20 user devstack@n-api.service[61852]: X-User-Id: f6576467073e41e9b497097d5a8dfd3d Apr 12 11:06:20 user devstack@n-api.service[61852]: X-User-Name: tempest-AttachVolumeTestJSON-1953237893-project-member Apr 12 11:06:20 user devstack@n-api.service[61852]: method: > Apr 12 11:06:20 user devstack@n-api.service[61852]: exception: Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 could not be found. Apr 12 11:06:20 user devstack@n-api.service[61852]: action_args: {'id': '8a514b7a-d2a1-40d4-9b25-106a07771d72'} Apr 12 11:06:20 user devstack@n-api.service[61852]: {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 could not be found. Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 could not be found. Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 could not be found. Apr 12 11:06:20 user devstack@n-api.service[61852]: ERROR nova.api.openstack.wsgi Apr 12 11:06:20 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-930893d3-b72a-4b78-ae35-5c57f568ab83 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Returning 404 to user: Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 could not be found. {{(pid=61852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:06:20 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-930893d3-b72a-4b78-ae35-5c57f568ab83 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72" status: 404 len: 111 microversion: 2.1 time: 0.031803 Apr 12 11:06:20 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 380/1140] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:06:20 2023] GET /compute/v2.1/servers/8a514b7a-d2a1-40d4-9b25-106a07771d72 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 11:06:22 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a4269060-fd3f-400f-9d0e-702c18e84df3 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:06:22 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-a4269060-fd3f-400f-9d0e-702c18e84df3 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:06:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a4269060-fd3f-400f-9d0e-702c18e84df3 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:06:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a4269060-fd3f-400f-9d0e-702c18e84df3 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:06:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a4269060-fd3f-400f-9d0e-702c18e84df3 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:06:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a4269060-fd3f-400f-9d0e-702c18e84df3 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:06:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a4269060-fd3f-400f-9d0e-702c18e84df3 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:06:22 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-a4269060-fd3f-400f-9d0e-702c18e84df3 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:06:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-a4269060-fd3f-400f-9d0e-702c18e84df3 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] HTTP exception thrown: Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 could not be found. Apr 12 11:06:23 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a4269060-fd3f-400f-9d0e-702c18e84df3 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Request method failure captured: Apr 12 11:06:23 user devstack@n-api.service[61853]: request: DELETE /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644 HTTP/1.1 Apr 12 11:06:23 user devstack@n-api.service[61853]: Accept: application/json Apr 12 11:06:23 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 11:06:23 user devstack@n-api.service[61853]: Connection: close Apr 12 11:06:23 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 11:06:23 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 11:06:23 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 11:06:23 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 11:06:23 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 11:06:23 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNo19dItcj2uv6a-AGLGCE-o0Ed4Y6q4btTvpdeiBX0cYjwWCro5TnX1r5gTDzerBUv1mHixLTpPEgMwshuG3-7kJTzxwiwj5d6ZrPYs6Jd-W0IlKnmEOC1yas6y46z-yOKavHnIUSN7LUFJaAxj4gC5DMvrhYC0CUus_q1tB8gbB_UU Apr 12 11:06:23 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 11:06:23 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 11:06:23 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 11:06:23 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 11:06:23 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 11:06:23 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 11:06:23 user devstack@n-api.service[61853]: X-Project-Id: 9878bfe34ceb4a6695b253ad161c4f7b Apr 12 11:06:23 user devstack@n-api.service[61853]: X-Project-Name: tempest-AttachVolumeTestJSON-1953237893 Apr 12 11:06:23 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 11:06:23 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 11:06:23 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9878bfe34ceb4a6695b253ad161c4f7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9878bfe34ceb4a6695b253ad161c4f7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9878bfe34ceb4a6695b253ad161c4f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:06:23 user devstack@n-api.service[61853]: X-Tenant: tempest-AttachVolumeTestJSON-1953237893 Apr 12 11:06:23 user devstack@n-api.service[61853]: X-Tenant-Id: 9878bfe34ceb4a6695b253ad161c4f7b Apr 12 11:06:23 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1953237893 Apr 12 11:06:23 user devstack@n-api.service[61853]: X-User: tempest-AttachVolumeTestJSON-1953237893-project-member Apr 12 11:06:23 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 11:06:23 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 11:06:23 user devstack@n-api.service[61853]: X-User-Id: f6576467073e41e9b497097d5a8dfd3d Apr 12 11:06:23 user devstack@n-api.service[61853]: X-User-Name: tempest-AttachVolumeTestJSON-1953237893-project-member Apr 12 11:06:23 user devstack@n-api.service[61853]: method: > Apr 12 11:06:23 user devstack@n-api.service[61853]: exception: Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 could not be found. Apr 12 11:06:23 user devstack@n-api.service[61853]: action_args: {'id': '2aef35e7-5daf-4d41-b91b-a7ff4a481644'} Apr 12 11:06:23 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 could not be found. Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 could not be found. Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 could not be found. Apr 12 11:06:23 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:06:23 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-a4269060-fd3f-400f-9d0e-702c18e84df3 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Returning 404 to user: Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:06:23 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-a4269060-fd3f-400f-9d0e-702c18e84df3 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644" status: 404 len: 111 microversion: 2.1 time: 0.034618 Apr 12 11:06:23 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 375/1141] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 11:06:22 2023] DELETE /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 11:06:23 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-1a6116d6-def9-4cfa-adbb-a05f14e8dc4e tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:06:23 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-1a6116d6-def9-4cfa-adbb-a05f14e8dc4e tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:06:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1a6116d6-def9-4cfa-adbb-a05f14e8dc4e tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:06:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1a6116d6-def9-4cfa-adbb-a05f14e8dc4e tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:06:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1a6116d6-def9-4cfa-adbb-a05f14e8dc4e tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:06:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1a6116d6-def9-4cfa-adbb-a05f14e8dc4e tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:06:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1a6116d6-def9-4cfa-adbb-a05f14e8dc4e tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:06:23 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-1a6116d6-def9-4cfa-adbb-a05f14e8dc4e tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:06:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.wsgi [None req-1a6116d6-def9-4cfa-adbb-a05f14e8dc4e tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] HTTP exception thrown: Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 could not be found. Apr 12 11:06:23 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-1a6116d6-def9-4cfa-adbb-a05f14e8dc4e tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Request method failure captured: Apr 12 11:06:23 user devstack@n-api.service[61854]: request: GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644 HTTP/1.1 Apr 12 11:06:23 user devstack@n-api.service[61854]: Accept: application/json Apr 12 11:06:23 user devstack@n-api.service[61854]: Accept-Encoding: identity Apr 12 11:06:23 user devstack@n-api.service[61854]: Connection: close Apr 12 11:06:23 user devstack@n-api.service[61854]: Content-Length: 0 Apr 12 11:06:23 user devstack@n-api.service[61854]: Content-Type: application/json Apr 12 11:06:23 user devstack@n-api.service[61854]: Host: 10.0.0.210 Apr 12 11:06:23 user devstack@n-api.service[61854]: Openstack-System-Scope: None Apr 12 11:06:23 user devstack@n-api.service[61854]: User-Agent: python-urllib3/1.26.15 Apr 12 11:06:23 user devstack@n-api.service[61854]: X-Auth-Token: gAAAAABkNo19dItcj2uv6a-AGLGCE-o0Ed4Y6q4btTvpdeiBX0cYjwWCro5TnX1r5gTDzerBUv1mHixLTpPEgMwshuG3-7kJTzxwiwj5d6ZrPYs6Jd-W0IlKnmEOC1yas6y46z-yOKavHnIUSN7LUFJaAxj4gC5DMvrhYC0CUus_q1tB8gbB_UU Apr 12 11:06:23 user devstack@n-api.service[61854]: X-Domain-Id: None Apr 12 11:06:23 user devstack@n-api.service[61854]: X-Domain-Name: None Apr 12 11:06:23 user devstack@n-api.service[61854]: X-Identity-Status: Confirmed Apr 12 11:06:23 user devstack@n-api.service[61854]: X-Is-Admin-Project: True Apr 12 11:06:23 user devstack@n-api.service[61854]: X-Project-Domain-Id: default Apr 12 11:06:23 user devstack@n-api.service[61854]: X-Project-Domain-Name: Default Apr 12 11:06:23 user devstack@n-api.service[61854]: X-Project-Id: 9878bfe34ceb4a6695b253ad161c4f7b Apr 12 11:06:23 user devstack@n-api.service[61854]: X-Project-Name: tempest-AttachVolumeTestJSON-1953237893 Apr 12 11:06:23 user devstack@n-api.service[61854]: X-Role: member,reader Apr 12 11:06:23 user devstack@n-api.service[61854]: X-Roles: member,reader Apr 12 11:06:23 user devstack@n-api.service[61854]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9878bfe34ceb4a6695b253ad161c4f7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9878bfe34ceb4a6695b253ad161c4f7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9878bfe34ceb4a6695b253ad161c4f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:06:23 user devstack@n-api.service[61854]: X-Tenant: tempest-AttachVolumeTestJSON-1953237893 Apr 12 11:06:23 user devstack@n-api.service[61854]: X-Tenant-Id: 9878bfe34ceb4a6695b253ad161c4f7b Apr 12 11:06:23 user devstack@n-api.service[61854]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1953237893 Apr 12 11:06:23 user devstack@n-api.service[61854]: X-User: tempest-AttachVolumeTestJSON-1953237893-project-member Apr 12 11:06:23 user devstack@n-api.service[61854]: X-User-Domain-Id: default Apr 12 11:06:23 user devstack@n-api.service[61854]: X-User-Domain-Name: Default Apr 12 11:06:23 user devstack@n-api.service[61854]: X-User-Id: f6576467073e41e9b497097d5a8dfd3d Apr 12 11:06:23 user devstack@n-api.service[61854]: X-User-Name: tempest-AttachVolumeTestJSON-1953237893-project-member Apr 12 11:06:23 user devstack@n-api.service[61854]: method: > Apr 12 11:06:23 user devstack@n-api.service[61854]: exception: Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 could not be found. Apr 12 11:06:23 user devstack@n-api.service[61854]: action_args: {'id': '2aef35e7-5daf-4d41-b91b-a7ff4a481644'} Apr 12 11:06:23 user devstack@n-api.service[61854]: {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 could not be found. Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 could not be found. Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 could not be found. Apr 12 11:06:23 user devstack@n-api.service[61854]: ERROR nova.api.openstack.wsgi Apr 12 11:06:23 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-1a6116d6-def9-4cfa-adbb-a05f14e8dc4e tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Returning 404 to user: Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 could not be found. {{(pid=61854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:06:23 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-1a6116d6-def9-4cfa-adbb-a05f14e8dc4e tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644" status: 404 len: 111 microversion: 2.1 time: 0.029459 Apr 12 11:06:23 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 387/1142] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:06:23 2023] GET /compute/v2.1/servers/2aef35e7-5daf-4d41-b91b-a7ff4a481644 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 11:06:33 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:06:33 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:06:33 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1573222300", "imageRef": "3dd4c04b-7ffb-4200-9900-d3e99c6da7a0", "flavorRef": "42", "networks": [{"uuid": "c4caf2aa-9cd4-49ef-87c6-26505451e622"}]}} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:06:34 user devstack@n-api.service[61852]: DEBUG nova.network.neutron [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] validate_networks() for [('c4caf2aa-9cd4-49ef-87c6-26505451e622', None, None, None, None, None)] {{(pid=61852) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 11:06:34 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Flavor limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 11:06:34 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Image limits 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 11:06:34 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Flavor pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 11:06:34 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Image pref 0:0:0 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 11:06:34 user devstack@n-api.service[61852]: DEBUG nova.virt.hardware [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 11:06:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:06:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:06:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:06:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:06:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:06:34 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:06:34 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Getting quotas for project 80171401e13a447f9410c3a2bd339f59. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 11:06:34 user devstack@n-api.service[61852]: DEBUG nova.quota [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Getting quotas for user f0c5b108917440ad862967ea398c6ee1 and project 80171401e13a447f9410c3a2bd339f59. Resources: {'cores', 'instances', 'ram'} {{(pid=61852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 11:06:34 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Going to run 1 instances... {{(pid=61852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 11:06:34 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 11:06:34 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.813502 Apr 12 11:06:34 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 381/1143] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 11:06:33 2023] POST /compute/v2.1/servers => generated 378 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 11:06:34 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-8d13533d-4c98-40a5-8970-7321d92016dc tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:06:34 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-8d13533d-4c98-40a5-8970-7321d92016dc tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:06:34 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:06:34 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:06:34 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-8d13533d-4c98-40a5-8970-7321d92016dc tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5b108917440ad862967ea398c6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80171401e13a447f9410c3a2bd339f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:06:34 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-8d13533d-4c98-40a5-8970-7321d92016dc tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9963614d-458a-4521-94a8-8b6811efa9d0" status: 200 len: 1208 microversion: 2.1 time: 0.101401 Apr 12 11:06:34 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 376/1144] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:06:34 2023] GET /compute/v2.1/servers/9963614d-458a-4521-94a8-8b6811efa9d0 => generated 1208 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:06:37 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-a460fd8e-616b-4ed4-a5b8-87a81aebd7ea req-94422b05-bd49-47ad-a380-c2edbeaafe62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9963614d-458a-4521-94a8-8b6811efa9d0", "tag": "f73636a3-a1e1-4de0-ad09-375ffb94a996"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:06:37 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:06:37 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=4 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:06:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a460fd8e-616b-4ed4-a5b8-87a81aebd7ea req-94422b05-bd49-47ad-a380-c2edbeaafe62 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:06:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a460fd8e-616b-4ed4-a5b8-87a81aebd7ea req-94422b05-bd49-47ad-a380-c2edbeaafe62 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:06:37 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-a460fd8e-616b-4ed4-a5b8-87a81aebd7ea req-94422b05-bd49-47ad-a380-c2edbeaafe62 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:06:37 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-a460fd8e-616b-4ed4-a5b8-87a81aebd7ea req-94422b05-bd49-47ad-a380-c2edbeaafe62 service nova] Creating event network-changed:f73636a3-a1e1-4de0-ad09-375ffb94a996 for instance 9963614d-458a-4521-94a8-8b6811efa9d0 on user Apr 12 11:06:37 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-a460fd8e-616b-4ed4-a5b8-87a81aebd7ea req-94422b05-bd49-47ad-a380-c2edbeaafe62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041674 Apr 12 11:06:37 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 388/1145] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:06:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:06:39 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-bb17ef16-88f7-4014-a9f3-5b43a6b252dc req-e62d277f-9577-4d6d-aa1a-5a3df634852c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9963614d-458a-4521-94a8-8b6811efa9d0", "name": "network-vif-plugged", "status": "completed", "tag": "f73636a3-a1e1-4de0-ad09-375ffb94a996"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:06:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-bb17ef16-88f7-4014-a9f3-5b43a6b252dc req-e62d277f-9577-4d6d-aa1a-5a3df634852c service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:06:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-bb17ef16-88f7-4014-a9f3-5b43a6b252dc req-e62d277f-9577-4d6d-aa1a-5a3df634852c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:06:39 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-bb17ef16-88f7-4014-a9f3-5b43a6b252dc req-e62d277f-9577-4d6d-aa1a-5a3df634852c service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:06:39 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-bb17ef16-88f7-4014-a9f3-5b43a6b252dc req-e62d277f-9577-4d6d-aa1a-5a3df634852c service nova] Creating event network-vif-plugged:f73636a3-a1e1-4de0-ad09-375ffb94a996 for instance 9963614d-458a-4521-94a8-8b6811efa9d0 on user Apr 12 11:06:39 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-bb17ef16-88f7-4014-a9f3-5b43a6b252dc req-e62d277f-9577-4d6d-aa1a-5a3df634852c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028742 Apr 12 11:06:39 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 382/1146] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:06:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:06:41 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [req-d37739a5-6ea2-46de-912f-c6014a6f76f8 req-db1b0cba-43da-4a92-81d2-d81ef87f44ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9963614d-458a-4521-94a8-8b6811efa9d0", "name": "network-vif-plugged", "status": "completed", "tag": "f73636a3-a1e1-4de0-ad09-375ffb94a996"}]} {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:06:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d37739a5-6ea2-46de-912f-c6014a6f76f8 req-db1b0cba-43da-4a92-81d2-d81ef87f44ea service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:06:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d37739a5-6ea2-46de-912f-c6014a6f76f8 req-db1b0cba-43da-4a92-81d2-d81ef87f44ea service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:06:41 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [req-d37739a5-6ea2-46de-912f-c6014a6f76f8 req-db1b0cba-43da-4a92-81d2-d81ef87f44ea service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:06:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.compute.server_external_events [req-d37739a5-6ea2-46de-912f-c6014a6f76f8 req-db1b0cba-43da-4a92-81d2-d81ef87f44ea service nova] Creating event network-vif-plugged:f73636a3-a1e1-4de0-ad09-375ffb94a996 for instance 9963614d-458a-4521-94a8-8b6811efa9d0 on user Apr 12 11:06:41 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [req-d37739a5-6ea2-46de-912f-c6014a6f76f8 req-db1b0cba-43da-4a92-81d2-d81ef87f44ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038036 Apr 12 11:06:41 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 377/1147] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:06:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:07:24 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:07:24 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:07:24 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [None req-395024ce-a9e6-44a3-baa1-555de63ff4ba tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Calling method '>' {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:07:24 user devstack@n-api.service[61854]: DEBUG nova.compute.api [None req-395024ce-a9e6-44a3-baa1-555de63ff4ba tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Fetching instance by UUID {{(pid=61854) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:07:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-395024ce-a9e6-44a3-baa1-555de63ff4ba tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:07:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-395024ce-a9e6-44a3-baa1-555de63ff4ba tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:07:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-395024ce-a9e6-44a3-baa1-555de63ff4ba tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:07:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-395024ce-a9e6-44a3-baa1-555de63ff4ba tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:07:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-395024ce-a9e6-44a3-baa1-555de63ff4ba tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:07:24 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [None req-395024ce-a9e6-44a3-baa1-555de63ff4ba tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:07:25 user devstack@n-api.service[61854]: DEBUG nova.policy [None req-395024ce-a9e6-44a3-baa1-555de63ff4ba tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5b108917440ad862967ea398c6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80171401e13a447f9410c3a2bd339f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61854) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:07:25 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [None req-395024ce-a9e6-44a3-baa1-555de63ff4ba tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9963614d-458a-4521-94a8-8b6811efa9d0" status: 200 len: 1486 microversion: 2.1 time: 0.293087 Apr 12 11:07:25 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 389/1148] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:07:24 2023] GET /compute/v2.1/servers/9963614d-458a-4521-94a8-8b6811efa9d0 => generated 1486 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:08:29 user devstack@n-api.service[61852]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e43783b0-8632-4b2e-bcef-9bff327f536b] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 11:08:29 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=2 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:08:29 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell0:SELECT=6 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:08:29 user devstack@n-api.service[61852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 11:08:29 user devstack@n-api.service[61852]: Wed Apr 12 11:08:29 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9963614d-458a-4521-94a8-8b6811efa9d0 (ip 10.0.0.210) !!! Apr 12 11:08:29 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:08:29 user devstack@n-api.service[61852]: DEBUG dbcounter [-] [61852] Writing DB stats nova_cell1:SELECT=4 {{(pid=61852) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:08:29 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Calling method '>' {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:08:29 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Fetching instance by UUID {{(pid=61852) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:08:29 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:08:29 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:08:29 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:08:29 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:08:29 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:08:29 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:08:30 user devstack@n-api.service[61852]: DEBUG nova.compute.api [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Going to try to terminate instance {{(pid=61852) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 11:08:30 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9963614d-458a-4521-94a8-8b6811efa9d0" status: 204 len: 0 microversion: 2.1 time: 0.148343 Apr 12 11:08:30 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 383/1149] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 11:08:29 2023] DELETE /compute/v2.1/servers/9963614d-458a-4521-94a8-8b6811efa9d0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 11:08:30 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell0:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:08:30 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:08:30 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:08:30 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-f20339e9-a878-423c-9395-d58fe9582978 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:08:30 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-f20339e9-a878-423c-9395-d58fe9582978 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:08:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f20339e9-a878-423c-9395-d58fe9582978 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:08:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f20339e9-a878-423c-9395-d58fe9582978 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:08:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f20339e9-a878-423c-9395-d58fe9582978 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:08:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f20339e9-a878-423c-9395-d58fe9582978 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:08:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f20339e9-a878-423c-9395-d58fe9582978 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:08:30 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-f20339e9-a878-423c-9395-d58fe9582978 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:08:30 user devstack@n-api.service[61853]: DEBUG nova.policy [None req-f20339e9-a878-423c-9395-d58fe9582978 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5b108917440ad862967ea398c6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80171401e13a447f9410c3a2bd339f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61853) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 11:08:30 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-f20339e9-a878-423c-9395-d58fe9582978 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9963614d-458a-4521-94a8-8b6811efa9d0" status: 200 len: 1492 microversion: 2.1 time: 0.379423 Apr 12 11:08:30 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 378/1150] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:08:30 2023] GET /compute/v2.1/servers/9963614d-458a-4521-94a8-8b6811efa9d0 => generated 1492 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 11:08:30 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_api:SELECT=2 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:08:30 user devstack@n-api.service[61854]: DEBUG dbcounter [-] [61854] Writing DB stats nova_cell1:SELECT=6 {{(pid=61854) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:08:30 user devstack@n-api.service[61854]: DEBUG nova.api.openstack.wsgi [req-fdc69ca9-05b2-47a4-bccf-dc2528e863db req-5b209179-de8c-470d-8eb2-2c33bea46fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9963614d-458a-4521-94a8-8b6811efa9d0", "name": "network-vif-unplugged", "status": "completed", "tag": "f73636a3-a1e1-4de0-ad09-375ffb94a996"}]} {{(pid=61854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:08:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-fdc69ca9-05b2-47a4-bccf-dc2528e863db req-5b209179-de8c-470d-8eb2-2c33bea46fb5 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:08:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-fdc69ca9-05b2-47a4-bccf-dc2528e863db req-5b209179-de8c-470d-8eb2-2c33bea46fb5 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:08:30 user devstack@n-api.service[61854]: DEBUG oslo_concurrency.lockutils [req-fdc69ca9-05b2-47a4-bccf-dc2528e863db req-5b209179-de8c-470d-8eb2-2c33bea46fb5 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61854) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:08:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.compute.server_external_events [req-fdc69ca9-05b2-47a4-bccf-dc2528e863db req-5b209179-de8c-470d-8eb2-2c33bea46fb5 service nova] Creating event network-vif-unplugged:f73636a3-a1e1-4de0-ad09-375ffb94a996 for instance 9963614d-458a-4521-94a8-8b6811efa9d0 on user Apr 12 11:08:30 user devstack@n-api.service[61854]: INFO nova.api.openstack.requestlog [req-fdc69ca9-05b2-47a4-bccf-dc2528e863db req-5b209179-de8c-470d-8eb2-2c33bea46fb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133070 Apr 12 11:08:30 user devstack@n-api.service[61854]: [pid: 61854|app: 0|req: 390/1151] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:08:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 11:08:32 user devstack@n-api.service[61852]: DEBUG nova.api.openstack.wsgi [req-d47eea1e-59d4-419e-8028-27fd509cfe57 req-20bf4e28-9675-4f39-a3aa-29a3bb58ffe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9963614d-458a-4521-94a8-8b6811efa9d0", "name": "network-vif-plugged", "status": "completed", "tag": "f73636a3-a1e1-4de0-ad09-375ffb94a996"}, {"server_uuid": "9963614d-458a-4521-94a8-8b6811efa9d0", "name": "network-vif-deleted", "tag": "f73636a3-a1e1-4de0-ad09-375ffb94a996"}]} {{(pid=61852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 11:08:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d47eea1e-59d4-419e-8028-27fd509cfe57 req-20bf4e28-9675-4f39-a3aa-29a3bb58ffe3 service nova] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:08:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d47eea1e-59d4-419e-8028-27fd509cfe57 req-20bf4e28-9675-4f39-a3aa-29a3bb58ffe3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:08:32 user devstack@n-api.service[61852]: DEBUG oslo_concurrency.lockutils [req-d47eea1e-59d4-419e-8028-27fd509cfe57 req-20bf4e28-9675-4f39-a3aa-29a3bb58ffe3 service nova] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61852) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:08:32 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-d47eea1e-59d4-419e-8028-27fd509cfe57 req-20bf4e28-9675-4f39-a3aa-29a3bb58ffe3 service nova] Creating event network-vif-plugged:f73636a3-a1e1-4de0-ad09-375ffb94a996 for instance 9963614d-458a-4521-94a8-8b6811efa9d0 on user Apr 12 11:08:32 user devstack@n-api.service[61852]: INFO nova.api.openstack.compute.server_external_events [req-d47eea1e-59d4-419e-8028-27fd509cfe57 req-20bf4e28-9675-4f39-a3aa-29a3bb58ffe3 service nova] Creating event network-vif-deleted:f73636a3-a1e1-4de0-ad09-375ffb94a996 for instance 9963614d-458a-4521-94a8-8b6811efa9d0 on user Apr 12 11:08:32 user devstack@n-api.service[61852]: INFO nova.api.openstack.requestlog [req-d47eea1e-59d4-419e-8028-27fd509cfe57 req-20bf4e28-9675-4f39-a3aa-29a3bb58ffe3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033776 Apr 12 11:08:32 user devstack@n-api.service[61852]: [pid: 61852|app: 0|req: 384/1152] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 11:08:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 11:09:20 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1aced0b4-f099-459d-b9df-3ebc48514cf4 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Calling method '>' {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 11:09:20 user devstack@n-api.service[61853]: DEBUG nova.compute.api [None req-1aced0b4-f099-459d-b9df-3ebc48514cf4 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Fetching instance by UUID {{(pid=61853) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 11:09:20 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_api:SELECT=2 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:09:20 user devstack@n-api.service[61853]: DEBUG dbcounter [-] [61853] Writing DB stats nova_cell1:SELECT=6 {{(pid=61853) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 11:09:20 user devstack@n-api.service[61853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 11:09:20 user devstack@n-api.service[61853]: Wed Apr 12 11:09:20 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9963614d-458a-4521-94a8-8b6811efa9d0 (ip 10.0.0.210) !!! Apr 12 11:09:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1aced0b4-f099-459d-b9df-3ebc48514cf4 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:09:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1aced0b4-f099-459d-b9df-3ebc48514cf4 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:09:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1aced0b4-f099-459d-b9df-3ebc48514cf4 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:09:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1aced0b4-f099-459d-b9df-3ebc48514cf4 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "9de702a6-515a-4e6a-adff-f5fd602a6708" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 11:09:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1aced0b4-f099-459d-b9df-3ebc48514cf4 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 11:09:20 user devstack@n-api.service[61853]: DEBUG oslo_concurrency.lockutils [None req-1aced0b4-f099-459d-b9df-3ebc48514cf4 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9de702a6-515a-4e6a-adff-f5fd602a6708" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61853) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 11:09:20 user devstack@n-api.service[61853]: INFO nova.api.openstack.wsgi [None req-1aced0b4-f099-459d-b9df-3ebc48514cf4 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] HTTP exception thrown: Instance 9963614d-458a-4521-94a8-8b6811efa9d0 could not be found. Apr 12 11:09:20 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1aced0b4-f099-459d-b9df-3ebc48514cf4 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Request method failure captured: Apr 12 11:09:20 user devstack@n-api.service[61853]: request: GET /compute/v2.1/servers/9963614d-458a-4521-94a8-8b6811efa9d0 HTTP/1.1 Apr 12 11:09:20 user devstack@n-api.service[61853]: Accept: application/json Apr 12 11:09:20 user devstack@n-api.service[61853]: Accept-Encoding: identity Apr 12 11:09:20 user devstack@n-api.service[61853]: Connection: close Apr 12 11:09:20 user devstack@n-api.service[61853]: Content-Length: 0 Apr 12 11:09:20 user devstack@n-api.service[61853]: Content-Type: application/json Apr 12 11:09:20 user devstack@n-api.service[61853]: Host: 10.0.0.210 Apr 12 11:09:20 user devstack@n-api.service[61853]: Openstack-System-Scope: None Apr 12 11:09:20 user devstack@n-api.service[61853]: User-Agent: python-urllib3/1.26.15 Apr 12 11:09:20 user devstack@n-api.service[61853]: X-Auth-Token: gAAAAABkNpC3in6Rw5BwCpIGlfZeuDopTrGqUyDLrMew-6ySG8Jer9_-19-P17iUCBx4sK2dfwmwkV1W5Paupd1M1ppU05t-jvX9oBn7P4UKCyfThDR3oIm7E5irlDnyA_wfb-L0YDt9z65Lf_F6y6XqRIZYKddMyLWlWRcEpBQJXtQb4s3PocY Apr 12 11:09:20 user devstack@n-api.service[61853]: X-Domain-Id: None Apr 12 11:09:20 user devstack@n-api.service[61853]: X-Domain-Name: None Apr 12 11:09:20 user devstack@n-api.service[61853]: X-Identity-Status: Confirmed Apr 12 11:09:20 user devstack@n-api.service[61853]: X-Is-Admin-Project: True Apr 12 11:09:20 user devstack@n-api.service[61853]: X-Project-Domain-Id: default Apr 12 11:09:20 user devstack@n-api.service[61853]: X-Project-Domain-Name: Default Apr 12 11:09:20 user devstack@n-api.service[61853]: X-Project-Id: 80171401e13a447f9410c3a2bd339f59 Apr 12 11:09:20 user devstack@n-api.service[61853]: X-Project-Name: tempest-VolumesActionsTest-838117246 Apr 12 11:09:20 user devstack@n-api.service[61853]: X-Role: member,reader Apr 12 11:09:20 user devstack@n-api.service[61853]: X-Roles: member,reader Apr 12 11:09:20 user devstack@n-api.service[61853]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/80171401e13a447f9410c3a2bd339f59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/80171401e13a447f9410c3a2bd339f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/80171401e13a447f9410c3a2bd339f59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 11:09:20 user devstack@n-api.service[61853]: X-Tenant: tempest-VolumesActionsTest-838117246 Apr 12 11:09:20 user devstack@n-api.service[61853]: X-Tenant-Id: 80171401e13a447f9410c3a2bd339f59 Apr 12 11:09:20 user devstack@n-api.service[61853]: X-Tenant-Name: tempest-VolumesActionsTest-838117246 Apr 12 11:09:20 user devstack@n-api.service[61853]: X-User: tempest-VolumesActionsTest-838117246-project-member Apr 12 11:09:20 user devstack@n-api.service[61853]: X-User-Domain-Id: default Apr 12 11:09:20 user devstack@n-api.service[61853]: X-User-Domain-Name: Default Apr 12 11:09:20 user devstack@n-api.service[61853]: X-User-Id: f0c5b108917440ad862967ea398c6ee1 Apr 12 11:09:20 user devstack@n-api.service[61853]: X-User-Name: tempest-VolumesActionsTest-838117246-project-member Apr 12 11:09:20 user devstack@n-api.service[61853]: method: > Apr 12 11:09:20 user devstack@n-api.service[61853]: exception: Instance 9963614d-458a-4521-94a8-8b6811efa9d0 could not be found. Apr 12 11:09:20 user devstack@n-api.service[61853]: action_args: {'id': '9963614d-458a-4521-94a8-8b6811efa9d0'} Apr 12 11:09:20 user devstack@n-api.service[61853]: {{(pid=61853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9963614d-458a-4521-94a8-8b6811efa9d0 could not be found. Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9963614d-458a-4521-94a8-8b6811efa9d0 could not be found. Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9963614d-458a-4521-94a8-8b6811efa9d0 could not be found. Apr 12 11:09:20 user devstack@n-api.service[61853]: ERROR nova.api.openstack.wsgi Apr 12 11:09:20 user devstack@n-api.service[61853]: DEBUG nova.api.openstack.wsgi [None req-1aced0b4-f099-459d-b9df-3ebc48514cf4 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Returning 404 to user: Instance 9963614d-458a-4521-94a8-8b6811efa9d0 could not be found. {{(pid=61853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 11:09:20 user devstack@n-api.service[61853]: INFO nova.api.openstack.requestlog [None req-1aced0b4-f099-459d-b9df-3ebc48514cf4 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9963614d-458a-4521-94a8-8b6811efa9d0" status: 404 len: 111 microversion: 2.1 time: 0.047283 Apr 12 11:09:20 user devstack@n-api.service[61853]: [pid: 61853|app: 0|req: 379/1153] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 11:09:20 2023] GET /compute/v2.1/servers/9963614d-458a-4521-94a8-8b6811efa9d0 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)